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ABSTRACT 


A  computer  processing  technique  is  advanced  which  seeks 
to  retain  or  improve  data  information  context  while  reducing 
the  dimensionality  of  data  representation.  Defining 
information  context  as  the  relative  proximity  of  data 
points,  a  nonlinear  transformation  is  analytically  derived 
which  utilizes  Euclidean  distance  to  one  or  more  reference 
points  to  provide  a  measure  of  similarity  "between  data 
points.  The  nonarbitrary  reference  points  are  selectively 
manipulated  to  provide,  given  certain  contraints,  a  unique 
mapping  from  high  dimensional  space  to  one  or  more 
dimensions  for  each  point  in  space.  The  transformation 
process  enhances  class  clustering  and  interclass  separation 
in  the  lower  dimensional  representation. 

Computer  processed  experimental  results  are  presented  of 
reduction  from  32,  10,  and  3  space  into  2  space  for  both 
synthetic  and  real  world  data.  Utilizing  a  ratio  of 
intraclass  variance  to  interclass  variance  as  a  figure  of 
merit  and  as  one  possible  optimization  criterion,  this 
technique  yielded  a  significant  ratio  improvement  in  mapping 
from  higher  dimensional  space  into  2  dimensional  space  for 
all  cases  examined. 
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I.   INTRODUCTION 


In  the  widest  sense,,, patterns  are  the  means  hy  which  we 
interpret  the  world." 

WILLIAM  S.  MIESEL 


Data  hecomes  rreaningful  inf orrration  when  it  provides  a 
perspective  on  known  information.  In  its  most  general  sense, 
the  context  of  unlrnown  information  is  judged  by  its 
relationship  to  known  information.  The  most  numerous  pattern 
recognition  mechanism  on  the  planet  Earth,  man,  primarily 
judges  the  meaning  of  new  information  on  his  past 
experiences.  He  interprets  his  senses  relative  to  his 
personal  environment  and  experiences.  However,  the  methods 
by  which  man  precelves  new  experiences  relative  to  past 
experiences  is  not  yet  fully  understood. 

Mathematical  pattern  recognition,  using  digital 
computers,  attempts  to  emulate  the  human's  skill  at  pattern 
recognition,  albeit  poorly,  by  relating  new  information  to 
its  own  data  base  of  accumulated  information.  The  computer 
has  the  advantage  of  performing  pattern  recognition  in  high 
dimensional  spaces,  spaces  incomprehensible  to  man. 

A.   MOTIVATION 

Pattern   recognition  represents  information  as  numerical 
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values.  In  supervised  learning,  nurrerical  representations  of 
known  objects  are  compared  against  numerical  representations 
of  unknown  objects  in  an  attempt  to  recognize  the  unknown 
object.  The  complexity  of  analysis  rapidly  increases  as  more 
and  more  measures  of  an  object  are  collected.  Each  measure 
is,  in  numerical  form,  a  descriptor  of  some  attribute  of  an 
item,  be  it  a  physical  object,  an  event  in  time,  or  some 
metaphysical  relationship.  The  number  of  measures  of  a  item 
of  data  define  the  number  of  dimensions  in  space  in  which 
the  item  exists.  A  sample  of  an  object  is  defined  to  be  one 
set  of  measurements  of  that  object.  The  complexity  of 
evaluating  the  meaning  or  identity  of  an  sample  increases 
exponentially  as  the  number  of  dimensions  in  which  the 
object  is  described.  The  fact  that  procedures  which  are 
analytically  or  computationally  manageable  in  low  dimensions 
become  completely  impractical  with  high  dimensional 
representations  is  termed  within  the  pattern  recognition 
literature  as  the  "curse  of  dimensionality"  [1 ,2,31 . 

The  significance  of  information  is  not  in  its 
representation  but  in  its  context.  In  classifying  data 
relative  to  known  information  the  concern  is  recognition, 
not  representation.  The  premise  of  this  research  is  that  a 
transformation  exist  which  will  overcome,  to  some  extent, 
the  curse  of  dimensionality  by  reducing  information 
representation  while  retaining  context.  Viewed 
geometrically,  this  transformation  will  attempt  to  retain  or 
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enhance  relative  proxiirity  of  sirplliar  inforrration  and 
separate  the  relative  proximity  between  different 
information  sources  while  reducing  the  number  of  dimensions 
in  the  representation. 

B.   A  RELATIVE  PROXIMITY  SCENARIO 

Consider  the  problem  of  an  aircraft  navigator  equipped 
with  a  range  only  measuring  device.  The  navigator  knows  the 
general  location  of  his  aircraft  but  would  like  to  precisely 
fix  his  position.  In  doing  so,  he  measures  the  distance  to 
two  landmarks  conveniently  available  to  him  as  in  figure 
1.1.  He  then  circumscribes  a  cirle  around  each  of  the 
landmarks  ,each  with  a  radius  equal  to  the  distance  from  the 
aircraft  to  that  landmark.  Unless  he  is  exactly  on  the  line 
drawn  between  the  two  references  points  the  circles  drawn 
will  intersect  at  two  points.  By  knowing  his  general 
position,  that  is,  by  knowing  the  aircraft's  position 
/elative  to  that  line,  the  nagivator  can  resolve  the 
ambiguity  and  select  the  correct  intersection  as  his 
position. 

This  example,  greatly  generalized  and  viewed  from  the 
perspective  of  the  landmarks  rather  than  the  navigator,  is 
the  transformation  developed  in  this  thesis  to  reduce 
representation  while  retaining  relative  proximity  of 
simlliar  information. 
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Figure  1.1   Aircraft  position  determined  relative  to  two 
reference  points. 
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C.   SCOPE 

The  generalized  pattern  recognition  process  is  descrilDed 
to  provide  insight  into  the  role  of  dimensionality 
reduction.  Next  the  nonlinear  transformation  employed  to 
reduce  data  representation  is  analytically  derived.  This  is 
followed  by  geometric  illustrations  of  the  Transformation 
and  a  rationalization  of  its  effects  on  class  clustering. 
Results  of  specific  test  cases  are  described  and  graphically 
illustrated.  The  final  chapter  provides  conclusions, 
recommendations  for  applications,  and  further  research  areas 
in  this  methodology. 
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II.   THE  PATTEP.N  RECOGNITION  PROCESS 

A.  NATURE  OF  TEE  PROCESS 

"Pattern  classification  is  the  assignnent  of  a  physical 
object  or  event  to  one  of  several  prespecif ied  catagories 
"[1].  The  act  of  malcing  that  assignment  can  he  characterized 
"by  three  sequential  logical  component  processes  as  shown  in 
figure  2.1.  In  the  first  process,  the  physical  world  is 
sensed  by  sorre  transducer  system  which  transforms  data  into 
a  machine  processible  state.  The  transducer  changes  the 
physical  reality  of  an  object,  characterized  as  a  continuum 
of  parameters  and  infinite  in  dimensionality,  into  a  pattern 
space  whose  domain  is  defined  by  the  discretization  of 
sensor  data  observed  in  the  real  world.  This  discrete  set  of 
measurements  finitely  bounds  the  range  of  values  and  number 
of  dimensions  which  characterize  the  object.  Feature  space 
is  an  intermediate  domain  between  pattern  space  and 
classification  space.  There  may  be  one  or  more  subprocesses 
required  in  transforming  pattern  space  into  feature  space. 
This  transformation  into  feature  space  is  the  process, 
termed  feature  selection,  preprocessing,  or  feature 
extraction,  by  which  a  sample  representation  in  pattern 
space  is  described  by  a  finite  and  usually  smaller  sample 
representation  called  features.  Feature  space  is   a   reduced 
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FIGURE  2.1    The  pattern  recognition  process 
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representation  which  attempts  to  retain  as  much 
discriminating  power  as  possible  while  removing  as  much 
redundancy  as  possible.  The  transformation  from  feature 
space  to  classification  space  is  accomplished  via  a  set  of 
decision  rules  which  classify  an  unlabeled  (unknown)  sample 
of  an  object  as  a  member  of  one  of  the  known  data  sets.  The 
classification  problem  is  basically  one  of  partitioning  the 
feature  space  into  regions,  one  region  for  each  category. 
The  view  of  pattern  recognition  as  a  series  of  processes  was 
provided  by  H.  C.  Andr9ws[3].  Meisel  [2]  views  pattern 
recognition  as  a  series  of  states  in  which  the  data  exist. 
The  two  perspectives  are  logically  equivalent. 

B.   DIMENSIONALITY  REDUCTION 

In  describing  the  dimensionality  reduction  inherent  in 
feature  extraction  Duda  and  Hart  comment  : 


There  is  a  growing  body  of  theory  of  dimensionality 
reduction  for  pattern  classification.  Some  of  these 
methods  seek  to  form  new  features  out  of  linear 
combinations  of  old  ones.  Others  seek  merely  a  small 
subset  of  the  original  features.  A  major  problem 
confronting  this  theory  is  that  the  division  of  pattern 
recognition  into  feature  extraction  followed  by 
classification  Is  theoretically  artificial.  A  completely 
optimal  feature  extractor  can  never  be  anything  but  an 
optimal  classif ier .  [1] 


Andrews  states  : 


While  the  objective  in  defining  the  feature  space  is   to 
reduce   the  dimensionality   of   the  pattern   space  yet 
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maintaining  discriminatory  power  for  classif iction 
purposes,  successful  transformations  still  seem  in  their 
infancy.  There  eiist  a  variety  of  linear  transformations 
as  well  as  some  nonlinear  methods  which  are  developing 
particular  appeal  hut  the  real  frontiers  of  pattern 
recognition  still  lie  ahead  in  developing  a  viable 
feature  selection  transformation  that  undoes  the 
redundant  data  gathering  inherent  in  the  definition  of 
pattern  space.  [3] 


The  variety  of  feature  extraction  techniques  are  too 
numerous  to  mention  individually,  hut  can  he  discussed  as 
families  of  methodologies.  Principal  component  analysis 
techniques  attempt  to  maintain  discrimination  while  reducing 
the  dimensionality  of  data  representation  hy  selecting  a 
subset  of  measurements  from  pattern  space  which  contain  the 
most  variability.  The  objective  of  factor  analysis  is  to 
find  a  lower  dimensional  representation  that  accounts  for 
the  correlations  among  the  features.  The  multidimensional 
scaling  technique  reduces  the  dimensionality  while 
attempting  to  maintain  the  distance  relationships  between 
all  points  in  pattern  space  in  feature  space.  This  feature 
extractor  iteratively  processes  the  data  until  a  minimum 
error  exists  in  the  feature  space  representation  of  pattern 
space  distance  relationships.  Classical  discriminant 
analysis  attempts  to  find  a  lower  dimensional  surface  on 
which  to  project  the  data  samples  and  achieve  good 
separation  between  classes.  In  each  case  the  methodologies 
incur  some  loss  of  information  in  feature  extraction. 

The   intrinsic  meaning  of   the  data  points,  not  their 
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representation,  is  their  single  most  important  property.  An 
optimal  feature  extractor  must  not  lose  context  while 
reducing  data  representation.  Certainlly,  an/  feature 
extractor  which  reduces  the  context  while  reducing  the 
representation  is  sutoptimal.  Yet  the  term  feature  extractor 
itself  implies  retaining  some  information  while  discarding 
some  information.  Perhaps  a  change  of  perspective  is 
required  to  better  reduce  data  representations.  Consider  a 
method  of  representing  In  a  lower  dimension  the 
relationships  between  data  samples  in  pattern  space  rather 
than  the  data  itself.  The  relationships  are  the  significant 
factors,  not  the  representations,  for  they  define  the 
context  of  the  information. 

The  relationships  between  data  points  are  typically 
Judged  in  terms  of  distance  measures.  Meisel  astutely  noted 
"distance  is  crucial  in  pattern  recognition;  it  is  assumed, 
roughly,  that  the  closer  a  point  is  to  another  point,  the 
more  similar  are  the  patterns  represented  by  those 
points".  [2]  Multidimensional  scaling  capitalizes  on  this 
fact  by  attempting  to  retain  pattern  space  distance 
relationships  in  feature  space.  Yet  it  fails  to  do  so 
completely  since  the  distance  relationships  between  all 
points  can  not  be  explicitly  retained  in  any  less  than  the 
number  of  pattern  space  dimensions  unless  the  points  exist 
in  a  subspace  within  the  pattern  space. 

Again  recall  that  the  significant  factor  is  context,  not 
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representation.  Talcing  the  liljerty  of  paraphasing  Melsel's 
words,  the  greater  the  relative  proximity  of  one  point  to 
another  point,  the  greater  the  similarity  of  the  patterns 
represented  hy  those  points.  If,  in  reducing  the  data 
representation  dimensionality,  the  relative  proxirrity  of 
similar  information  is  maintained  then  it  seems  intiutlve 
that  little  loss  of  context  has  occured  in  the 
transformation.  Multidimensional  scaling  severly  constraints 
itself  by  attempting  to  maintain  distance  relationships  in 
lower  dimensions.  The  transformation  presented  here  will 
forego  maintaining  distance  relationships  "between  all  points 
in  lieu  of  maintaining  relative  proximity  "between  similar 
data  points.  * 

C.   GENERAL  APPROACH  TO  A  RELATIVE  PROXIMITY  TRANSFORMATION 

In  developing  this  nonlinear  transformation  use  is  made 
of  two  axioms  : 

1.  the  distance  between  two  points  in  n  dimensional  space 
is  a  scalar  value; 

2.  an  n  dimensional  lattice   space   is   relatively   sparse 
compared  to  n  dimensional  continuous  space. 

These  facts   are  of  vital   slgnifinance  in  the  ability  to 
reduce  representation  without  loss  of  context. 

The  distance  from  one  point   to   another  point   is   a 
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measure  of  the  relative  proximity  of  the  points.  In  one 
dimension,  the  similarity  or  lack  of  similarity  in  distance 
from  a  reference  point  to  all  other  points  in  effect  defines 
each  point's  relative  proximity  to  one  another.  By 
generalising  to  n  dimensions  and  constraining  the  data  space 
to  remove  ambiguity,  the  context  of  points  in  n  dimensions 
may  he  measured  by  their  similarity  in  distance  to  one  or 
more  known  reference  points. 

The  selection  of  reference  points  will  be  based  on  a 
criterion  of  retaining,  if  not  improving,  relative  proximity 
of  similar  representations,  separating  dissimilar 
representations,  and  providing  a  unique  mapping  from  n 
dimensional  pattern  space  to  an  m  (m  >  1)  dimensional 
feature  space. 


22 


III.    N~DIMENSIONAL  NONLINEAR  TRANSFORMATIONS 

This  chapter  considers  the  representation  of  known  data 
samples  In  pattern  space.  Their  representations  in  pattern 
space  produce  several  constraints  and  assumptions  about  that 
space  which  allow  nonlinear  transformations  to  reduce  the 
dimensionality  of  their  representations.  In  subsequent 
chapters  it  will  he  shown  that  the  reduced  representation 
retains  or,  more  likely,  improves  any  clustering  present  in 
samples  of  the  same  ohject.  This  irrplies  that  the 
information  context  of  the  reduced  representation  is  at 
least  maintained  if  not  improved  in  the  lower  dimension 
representation.  The  case  of  a  two  dimensional  pattern  space 
to  two  dimensional  distance  space  transform  is  first 
developed,  followed  hy  a  three  dimensional  pattern  space  to 
two  dimensional  distance  space  transformation.  A  discussion 
of  n  dimensional  to  m  dimensional  transforms  conclude  the 
chapter . 

A.   DEFINITIONS 

Let  X.    =   (r,  .  ,x^.  ,..,i  .  )  he  the   i   th  sample  vector 
1        11   2i     ni 

In  pattern  space  describing  an  object  where  : 
x^   (J  =  l,n)   is  a  real  number; 
n  is  the   finite  number   of  dimensions   in 
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the  sample  vector. 

Let  D.  =  (d,  .  ,d^  .  , . . . ,d  .)   be  the  ordered  representation  of 
1      11   2i      mi 

the  1   th  sample  in  distance  space-'-  where  : 

m  is  the  finite  number   of  dimensions   in 

the  distance  vector, 
dj^   (k  =  l,m)   is  a  real  number 

where   (d  )  is  the  Euclidean   distance 

k 

from  a  designated  reference  point  (P]^) 

to  a  sample  point  (X. ); 
The  Euclidean  distance  (d,  )  is  defined  to  have  the  following 
properties  for  any  three  distinct  points  (x.  ,i.  ,i  )  i  /^  j  : 

1    J    K 

d(ii,Xj)  =  [  ?(ihi  -  x^^)^]^/2  d(Xi,Xj)  >  0 

d(x^,x^)  =  0  d(xi,Xj  )  =  d(Xj,Ti) 

d(x.  ,x.  )  +  d(x. ,x  )  >  d{x. ,x  ) 

ID        H   k   -     Ik 

A  nonlinear  transformation  (T)  is  defined  such  that 

T  :  (  I   >  D   ) 

i        i 

B.   TRANSFORMATION  FROM  TVO  DIMENSIONAL  PATTERN  SPACE  INTO 
TWO  DIMENSIONAL  DISTANCE  SPACE 

In  considering  the  two  dimensional  transformation  (T) 
recall  the  example  of  the  navigator.  In  that  situation,  the 
navigator  knew    the   aircraft's   approximate   position, 


The  term  distance  space  is  utilized  in  lieu  of  feature 
space  since  the  features  are  distances  from  reference  points 
rather  than  a  subset  of  measurements  from  pattern  space  as 
might  be  done  ,  for  example,  in  principal  component 
anaylsis. 
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effectively  limiting  the  area  in  which  he  could  "be  precisely 

located.  In  the  general  case  in  two  dimensions  one  method  to 

locate  a  point  in  space  precisely  is  to  constrain  that  point 

to  a   certain  region   as   in  the  case  of  the  navigator.  In 

constraining  a  point  to  remove  ambiguity  two   factors   enter 

into  consideration.   In   supervised   learning  an  attempt  is 

made  to  identify  an  object  solely  on  its  proximity  to   other 

identified   points.  The  range  of  values  of  the  Irnown  objects 

are  precisely  defined  and  the  unknown  sample  values  will   be 

approximately  equal   to   the  known  values.  Secondly,  recall 

that  the  navigator  had  to  know  his  general  position  relative 

to  a  line  drawn  between  the  two  reference  points  to   resolve 

the  ambiguity  in  choosing  which  of  the  two  intersections  was 

his  position.  Knowing  the  approximate  range  of  values  allows 

selection  of  a  constant  scaling  factor  which  will  scale  all 

points  into  nonnegative  space.  By  scaling   the  data   to   be 

nonnegatlve  most   ambiguity  is  removed  as  all  intersections 

occuring  outside  nonnegative  space  can  be   rejected,   as   in 

figure  3.1a. 

To   remove   any  ambiguity  caused  by  both  intersections 

occuring  within  the  constrainted  pattern  space   restrictions 

are   placed  on  reference  points  R  and  R  .  For  computational 

-12 

simplicity  reference  point  one  (R  )  is  defined  as  the 
origin.  A  valid  reference  point  two  {'R^  )  is  defined  such 
that  one  and  only  one  intersection  will  occur  within  pattern 
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Figure  3.1a   A  two  dimensional  representation  of  a  valid 
reference  point  two. 


original 

pattern 

space 


cons traint ed 

pattern 

space 


This  reference  point  two  is  valid  for  this  situation 
in  that  only  one  point  of  intersection  lies  within 
constrainted  pattern  space. 
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2  ,   , 

space  .  The  values  of  valid  reference  point   twos   (E  )   are 

generally  not   bounded  and  are  infinite  in  number  even  with 

the  uniqueness  constraint.  The  distance  from  each   reference 

point   to  a   point  in  the  pattern  space  lattice  defines  the 

radius  of  a  circle.  The  intersection  of   the  circles  about 

each   of   the   reference  points   defines   a  point  in  space. 

Figure  3.1a  illustrates  the  case  of  a  valid  R  and  R  .   Note 

that   of   the   two  intersections  defined  by  the  circles  only 

one   exist   in   constrainted  pattern   space.   Figure   3.1b 

demonstrates   an   invalid   R    in   that   two   points   of 

intersection  exist  in  constrainted  pattern  space. 

The  two  dimensional  pattern  space  into   two   dimensional 

distance  space  transformation  may  be  stated  in  the  following 

manner  : 

Given  a   set  of   samples  1^   =  (yii»y2i^  *  ^^  ^  1, number  of 

samples) 
in  pattern  space  where 

0  <  yjj^  +  k  <   a^    (j  =  1,2) 

a.  is  the  maximum  value  which  the 

i   th  element  may  assume; 
k  is  a  scale   factor  such  that  the 

minimum  value  of  y. .  +  k  >  0; 


2 
From  this  point  forward  in  the  discussion,  the  term  pattern 

space   implies   a   nonnegative,   maximally   bounded   pattern 
space. 
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Figure  3.1b   A  two  dimensional  representation  of  an 
invalid  reference  point  two. 


cons  trainted 
pat  tern 
space 


Ambiguity  exists  as  there  are  two  points  of  intersection 
defined  within  constrainted  pattern  space. 
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Xji  =  yji  >  If 

X^  =  {t-^^,X2^)  fii   =  l.number  of  samples) 

Is  the  set  of  samples  in 
constralnted  pattern  space 
there  exist  a  set  of  samples   D^^  =  ({l,.,d2-)  in  distance 
space  obtained  through  the  nonlinear  transformation 

T  :  (  X^ >  D^  ) 

where 

dji  =  CS  (iji-  Tj)  ^  i   (J  =l,2),(i  =  1, number  of 
samples)     is  the  Euclidean  distance 

function  as  defined  above   {3.1} 
Hi  =  (0,0) 

^2  ~  ^  Pi»P2  ^      ^^  ^  valid  reference  point. 
A  reference  point  two  is  valid  for  two  space  if  and  only  if 
there  exist  one  and  only  one  solution  within  pattern  suace 
to  the  simultaneous  equations  defining  (d^)  and  (d2)  for  all 
points  in  pattern  space. 

C.    TRANSFORMATION  FROM  THREE  DIMENSIONAL  PATTERN  SPACE 
INTO  TWO  DIMENSIONAL  DISTANCE  SPACE 

Observe  in  figure  3.2  the  radii  (di,d2)  computed  as  the 
distance  from  a  reference  point  to  a  sample  point 
geometrically  describe  spheres  in  three  dimensions.  The 
intersection  of  the  two  spheres  formed,  respectively,  of  the 
radii  di,d2  from  Ri,R2  defines  a  circle  in  two  dimensions. 
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The  circle  of  intersection 
contains  only  one  lattice 
point  of  the  constrainted 
pattern  space . 


cons  trainted 
pat  tern 
sp  ace 


circle  of 
tersection 


Figure  3.2   A  three  dimensional  valid  reference  point 
two  . 


30 


In  continuous  space  all  points  on  the  circle  of  intersection 
are  equally  defined  by   the  ordered  pair   (di,d2)   in   two 
space.   To   remove   this  most  uncomfortable  ambiguity  of  an 
infinite  number  of  points  in  pattern  space  mapping  into   one 
point  in  distance  space  consider  the  following  assumptions  : 
assumption  1  pattern  space  may  be  represented  as  a  lattice 
of  discrete  nonnegative,  maximally  bounded 
points  separated  by  a  unit  distance; 
assumption  2   the  circle  described  by  the   intersection  of 
the  spheres  is  constructed  to  contain   one  and 
only  one  lattice  point; 
assumption  3  a  valid  reference  point  two   (R2)   exist  which 
manipulates  the  circle   of   intersection   such 
that  assumption   two  will  be  true  for  all  lat- 
tice points   in  the  pattern  space  defined  by 
assumption  one. 
Assumption    three   is   logically   valid,    provided 
assumption  one  is  true,  if   and   only   if   there  exist   the 
ordered  pairs 


^i   =  ^^Ii<^2i)  ^^^  ^j   =  ^<ilj»<^2j)  ^or  all  X^,  Ij   i  7^  J 

discrete  sample  points  in  three  dimensional  pattern  space 

where 
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"I  [(d3_i=(i-L.)  A  {d2i=^2i)^  ^°r  ^11  ^i»^i   i  ^  J 


{3.2} 


Restating   equation   3.2   such   that  when   the  following 

equivalent  equations  are  both  false  for  all  points  Xj_tX-j   (i 

¥■   J)  in  pattern  space  R2  ~  (  Pi»P2»P3  ^  ^^  ^   valid  reference 
point . 


^li  -  ^Ij  -^ 


^2i  -  ^2j 


=  0 


{3.3} 
{3.4} 


Expanding  equation  3.4,   in  considering  a  three  space  into 
two  space  transformation,  yields  : 


(X.  -  R9)   -  (I^  -  Ro  )   =  0 


i   ^2 


J   "2 


{3.5} 


Squaring  and   collecting  terrrs   results   in    : 


^li^    *   ^2i^    *  ^3i^  "   ^Ij^   "    ^2j^      -   ^3j^    "•   23ti^Pi    ■"    2x9, P9    + 


2x 


3jP3      "   2XiiPi  -   2x2iP2   -   2l3iP3 


=   0 


Ij^'l    '    ""2j^2 
{3.6} 


2  2  2 

Equation  3.1   allows   substitution   of   D-^^^     for    (x-j^^     +   X2j^        + 

2  2  2  2  2 

i3j_      )    and   -^i-j     =    ^"^Ij     "^2^     ~^3j      ^    ^^^  utilizing   vector 
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notation   for   R    ,    x   ^'5    ^nd   x    ^*    then 
2         1  j 


^li^-  ^Ij^*  2R2  '^    (Xj   -  Xi)    =  0  {3.7} 


Equation  3.7  is  the  logical  complement  to  equation  2.2  since 
only  when  the  equality  holds  will  a  point  R2  =  (  Pi.P2»P3  ) 
"be  invalid  . 

Assumption  three,  that  a  valid  reference  point  two  will 
always  exist  when  assumption  one  is  true,  can  he  proven  in 
the  following  manner.  Two  sets  of  constants  are  present  in 
equation  3.7,  the  differences  between  the  distance  ones 
squared  and   the  differences   between   the  data  points  in 

pattern  space  for  all  points  (X^^  ,  X.  ),  (i  i-   J).   Selecting 

3 
the  largest  difference  in  magnitude   between  distance  ones 

squared  and  the  minimum  difference  in  magnitude  between  data 

points  (X.)  and  (X.)  then  a  reference  point  two   can   easily 

"be  selected   such   that  the  magnitude  of  the  dot  product  of 

the  candidate  reference  point  two  and  the  minimum  difference 

between  data  points  (X.  ,  X.)  is   always   greater   than   the 

maximum   difference   in  magnitude  between   distance   ones 

squared.  Once  the  minimum  reference  point  two  is  found  then 


The  minimum  difference  in  magnitude  is  that  difference 
whose  absolute  value  is  closest  to  the  origin.  Conversely, 
the  maximum  difference  in  magnitude  is  that  difference  whose 
absolute  value  is  most  distant  from  the  origin. 
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every  linear  com"bination  of  that  point  Is  a  valid  reference 
point.  Furthermore,  every  point  larger  in  value  for  the 
maximum  case  and  smaller  in  value  for  the  negative  case  will 
be  valid  except  for  the  case  Pj_  =  p^  =  Pj^  In  symmetric 
pattern  space. 

Consider  the  example   of   a   three  dimensional   pattern 
space   which    is   exhaustively  defined   for  all   linear 

combinations  of  integer  lattice  points  in  the  range  of   0  - 

2       2 
6,   The   magnitude   of  the  maximum  (D^^  -  D-^.  )  is  128.  The 

minimum  magnitude  of  the  difference  (Xj  -  X^)    is   the  point 

(0,0,1).   In  accordance  with  equation  3.7,  a  reference  point 

two  is  easily  found  such  that 

max   magnitude  (D-[_j_^  -  D^j^)   <   2    (R2'^("in   magnitude(Xj  -  1^))) 

{3.8} 

For  this  example, 

108  <  2(  R2  *  (  0,0,1)) 
implies  R2  =  (0,0,55) 

In  effect,  assumption  three  states  there  will  always 
exist  a  unique  mapping  from  three  space  to  one  space  for 
discrete  data. 

When  equation  3.3  is  considered  in  addition  to  equation 
3.4  then  another  degree  of  freedom  is  present.  The  net 
result  of  this  combination  is  that  valid  reference  point 
twos  will  exist  inside  the  bounds  defined  by  considering 
equation  3.4  alone.   At  present  valid  reference  point  twos 
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inside  the  bounds  can  only  be  determined  by  exhaustive 
searches  attempting  to  validate  a  candidate  reference  point 
two  with  equation  3.7. 

D.   TRANSFORMATION  FROM  N  DIMENSIONAL  PATTERN  SPACE  INTO    M 
DIMENSIONAL  DISTANCE  SPACE 

Generalizing  figure  3.2  into  n  dimensional  space,  the 
radius  of  intersection  forms  a  (n  -  1)  dimensional 
hypersurface  in  n  space.  All  the  constraints  and  assumptions 
of  the  three  space  transform  remain  valid  for  the  n 
dimensional  case.  The  derivation  in  the  previous  section 
that  a  valid  reference  point  two  always  exist  in  three  space 
is  but  one  case  of  the  n  dimensional  argument.  To  extend  the 
proof  to  n  space  simply  increase  the  indices  of  the  vectors 
to  the  desired  value  of  n.  There  is  no  difficulty  in  mapping 
a  (n  -  1)  dimensional  hypersphere  defined  by  the  radius  of 
intersection  of  m  spheres  into  a  single,  unique  point  in  m 
space  where  m  ranges  from  one  to  infinity. 

The  n  dimensional  transformation  may  be  stated  as  : 

Given  a  set  of  sample  data  points  Y^  =  ^7 i^ty 2i» • • »y ni-  * ^ ^  ~ 
1,  number  of  samples)  in  pattern  space  where  there  exists  a 
set  of  points   X.  =  (x  ,  .,x  ~  . , . . .  ,x  . )  ,  (i  =  1, number  of 
samples)  where  X  .  is  constrainted  to  be 

1.   nonnegative  y^i"*"  1^  >  0 

ji  ^1 


x..=  35.  *  ic 
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2.  maximally  bounded  ^ii^  ^i 

3.  a  member  of  the  set  of  lattice      x..^{P} 
points  with  a  unit  separation       P  =  {all  lattice 
between  points  points} 

k   is  a  constant  scale  factor  such  that  all  possible 

points  in  data  space  are  nonnegative  values 
a^  is  the  maximum  value  a  {x  ^     may  assume 

there  exist  a  set  of  sample  points  !)-[_=   ^^  li**  2i*  *  * ''^mi^  ^° 

distance  space 

where 

dbi""   [Z(Xj^-Rj^)^  f""^^  (b  =  l,m)    is  the  Euclidean 

distance 
Rl  =   (0,0 0  ) 

^b  ^   ^P  lb»P  2b»  ••• 'P  nb^  ^^  ^  ^ *^^      ^^^   defined  by 

equation  3.2 

While   it   has   not   been  proven  formally,  the  allowable 

unit   separation   between   points   is  hypothesized   to   be 

minimally   bounded   on   the   numerical   precision   of   the 

discretization  process   employed   to    transform   physical 

embodiment  into  machine  representation. 

E.  SU^^KART 

A  powerful  nonlinear  transformation  has  been  developed 
which  provides  a  one-to-one  mapping  from  n  space  to  m  space, 
where  typically  (m<<n).  The  effects  of  this  transform  on  the 
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information   content   and   cluster   formation   in   the 
representation  are  presented  in  the  following  chapters. 
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IV.    TRANSrORMATION  EFFECTS  ON  CLUSTERING 

The  number  of  valid  reference  points  (R,  )  has  been  shown 

b 

to  be  infinite.  Implicit  in  this  fact  is  the  choice  of 
transformations  is  also  infinite.  Given  this  infinite 
selection  of  transformations  the  objective  is  to  determine 
the  transform  which  provides  the  greatest  degree  of  class 
clustering  and  interclass  separation.  Measures  of 
improvement  are  discussed  as  a  means  to  accomplish  this 
objective. 

The  conversion  of  pattern  space  into  distance  space  is 
presented  geometrically  to  provide  some  insight  into  the 
transformation  process. 

A.   GEOMETRIC  INTERPRETATION  OF  CLUSTER  FORMATION 
IM  DISTANCE  SPACE 

The  unique  mapping  from  n  space  to  two  space  is  a 
function  of  the  (n  -  1)  space  tangent  hypersphere  generated 
by  the  intersection  of  the  radii  d  ,d  .  Recall  from  figure 
3.2  that  the  "direction"  in  which  the  tangent  surface  slices 
through  data  space,  the  range  of  values  for  the  curvature  of 
the  surface  of  the  tangential  hypersurface  over  pattern 
space  and  class  sample  point  dispersion  relative  to  that 
"direction"  shape  the  clustering  and  class  separation   which 
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occurs . 

The  change  in  curvature  of  the  surface  of  the  tangential 
hypersphere  Is  locally  minimal  but  over  the  entire  range  of 
the  data  space  may  he  quite  extreme,  depending  on  the  value 
of  reference  point  two.  Points  in  relatively  close  proximity 
will  have  approximately  the  same  tangential  curvature 
(figure  4.1a),  Points  which  are  relatively  distant  and 
clustered  perpendicular  to  the  tangent  line  will  experience 
a  greater  change  in  curvature  between  the  points  (figure 
4.1h).  Points  relatively  distant  hut  having  nearly  the  sarre 
tangent  curve  will  map  in  close  proximity  in  two  dimensional 
distance  space  (figure  4.1c).  Points  in  relative  proximity 
to  each  other,  in  the  sense  their  tangent  curves  are  in 
relative  proximity,  become  more  tightly  clustered  in 
distance  space.  The  physical  reality  of  this  fact  is  that 
the  points  in  relative  proximity  to  one  another  are  nearly 
equal  in  distance  to  reference  point  two. 

The  concept  of  relative  proximity  does  not  allow  total 
deinterleavlng  of  sample  points  of  different  classes. 
However,  any  class  separation  which  does  exist  in  any  one  or 
more  dimensions  in  pattern  space  can  be  enhanced  in  distance 
space  with  the  correct  choice  of  reference  point  two.  This 
enhancement  is  especially  noticable  when  distance  squared 
instead  of  distance  is  utilized  to  determine  an  element  of 
the  m  space  vector  since  distance  squared  emphasizes  the 
maximum  differences   between  elements  of  the  vectors  {1^   - 
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Figure  4.1a   Similar  tangent 
arcs  passing  through  a  cluster, 


Figure  4.1b  Variance  in 

curvature 
The  curvature  of  the  tangent 
arcs  slicing  through  cluster  A 
is  greater  than  that  of  the  arcs 
passing  through  cluster  B. 


A  AA 


Figure  4.1c   Mapping  effects  on 
different  classes  with  similar 
tangent  arcs . 


r/    <//<// 
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B.      MEASURES    OE    INFORMATION    CONTEXT 

One     criterion     for     deterrrining     the     degree     of     class 

clustering  and   interclass   separation   is   to   compare  the 

Intraclass  variability  to  the  interclass   variability.   Duda 

and  Hart   [l]   measure   this  variability  in   terms  of  the 

scatter  within  classes  (S^J  and  the  scatter  between   classes 

w 

(S  ).   Their   technique  will   be  utilized  in   computing  a 

information  context  measure  (I  ),  the  ratio  of  (S^^/S  )  in  q 

dimensional   space.   This  ratio  is  computed  in  the  following 
manner. \ 

A  q  dimensional  sample  mean  vector  for  class  i   is   computed 
as 


1 
M.   =    w.  2  X  {4.1} 

x6x. 


where 

M  .    is  the  mean  vector  for  class  i 

w.    is  the  number  of  samples  in  class  i 
1 

Xi    is  a  member  of  the  set  of  samples  in  class  i 

The  within  class  scatter  (S„)  is  the  sum  of  the  within  class 

w 

scatter   for   each   class.   The   within   class   scatter   is 
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calculated  as  the  distance  squared  from  a  class  rrean  to  all 
points  in  that  class. 


w. 


s„=Z    Tf^i-f^i)  (xr''i) 

j=l  1=1 


{4.2} 


where 

c     is  the  number  of  classes 

i     is  the  class  index 

(Xj_-M^)'^is  the  transpose  of  (X^  -  Mj_) 
To  calculate  the  scatter  between  classes  (Sg),  the  total 
mean  for  all  classes  must  be  determined. 


1  c 

Mm  =     Z   Z  V  T^  i 

i=l 


{4.3} 


where 


w.    is  the  number  of  points  in  class  i 
M  j^    is  the  mean  vector  for  class  i 
z     is  the  sum  of  w^^for  all  classes 
Then  the  scatter  between  classes  (Sg)  is 


Sg  =  _Zwi(Mi-  M^)  {M^-Mt)'^       {4.4} 


The  scatter  within  decreases  as  class  clustering  is 
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improved.  The  scatter  between  increases  as  interclass 
separation  increases.  The  ratio  fl  )  is  computed  to  measure 
the  interaction  of  those  two  facts.  Minimizing  this  ratio 
when  transforming  the  data  samples  from  pattern  space  to 
distance  space  is  a  measure  of  improvement  contributed  by 
the  transformation.  The  term  miminize  is  used  in  a  relative 
sense.  The  ratio  (I  )  will  approach  zero  as  the  separation 
between  classes  increases  to  infinity  or  the  intraclass 
scatter  decreases  to  zero.  Generally  that  degree  of 
separation  will  not  be  required.  By  providing  a 
geometrically  comprehensiable  representation  of  n  space  data 
in  one,  two,  or  three  dimensions  the  user  may  be  able  to 
discern  a  separation  which  is  sufficient  without  a  rrinimal 
(Ig)  ratio. 

The  (I  )  measure,  when  computed  as  (S^/Sg)  is,  in  the 
case  of  unimodal  class  distributions,  the  sum  of  squared 
error  criterion.  For  multimodal  class  distributions  and 
other  complex  class  distributions  other  optimality  measures 
will  be  more  appropriate.  Multimodal  class  distribution 
difficulties  can  sometimes  be  overcome  by  redefining 
multimodal  classes  into  separate  classes  and  applying  the 
(I  )  measure.  More  complex  problems  such  as  dense  clusters 
inside  a  diffused  cluster,  for  example  a  sphere  within  a 
sphere  or  interlocking  tori,  will  require  different 
information  measuring  criteria.  These  measures  are  typically 
application  dependent.   An   example   of  a  three  dimensional 
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cul)e  within  a  cube  is  presented  as  a  study  of  utilitizing 
the  (I  )  measure  on  complex  problems  in  the  following 
chapter. 

C.  TRANSFORMATION  EFFECTS  OF  ALTERNATIVE  REFERENCE  POINTS 

The  effect  of  passing  the  intersection  of  the  two 
hyperspheres  through  a  pattern  space  might  best  be  realized 
in  examining  a  geometrically  conceivable  example.  Consider  a 
three  dimensional  set  of  integer  points  bounded  on  the 
interval  (0  -  6).  This  data  set  is  inown  to  contain  two 
classes  separated  by  the  plane  x  =  y.  The  points  x  =  y  are 
members  of  neither  known  class.  Figure  4.2  illustrates  this 
example.  The  (I3)  ratio  in  three  space  for  this  data  set  was 
computed  to  be  1.699991.  An  arbitrarily  selected  reference 
point  two  R2  =  (18,21,-1)  yielded  a  (12)=  80.819992.  As 
shown  in  figure  4.3a  this  reference  point  generates  a  poor 
mapping  solution  in  terms  of  clustering  since  points  from 
distinctly  separated  classes  map  adjacent  to  one  another. 
Note  in  figure  4.3b  that  the  poor  solution  was  the  result  of 
a  reference  point  two  which  forced  the  tangential  surface 
direction  to  have  relative  proximity  across  classes.  A 
better  choice  of  R2  would  force  the  intersection  to  be 
nearly  parallel  to  the  known  class  separation.  Figure  4.4a 
shows  the  results  of  more  carefully  selected  R2 
(-999,999,1).  Here  the  (I2)  ratio  in  two  space  was   .200012. 
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Figure  4.2    A  bisected  cube 


I3  =  1.699991 
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Figure  4.3a  A  poor  mapping  solution  to  the  bisected  cube 


90  04^ 


Figure  4.3b  A  mapping  solution 
which  forces  the  tangent  curves 
across  clusters. 
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Figure  4.4a  A  nearly  optimalmapping  solution 


Figure  4.4b   A  mapping 
solution  which  separates 
classes  and  enhances  class 
clustering. 
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Figure  4.4b  is  a  presentation  of  this  data  in  two 
dimensional  distance  space.  This  IL  point  enhanced  the 
separation  to  the  extent  that  the  means  are  spread  must 
further  apart.  The  separation  between  classes  has  been 
enhanced . 

An  iterative  processing  technique  must  be  utilized  when 
class  separation  is  not  readily  apparent.  In  most  cases, 
varying  the  value  of  reference  point  two  toward  a  minimum 
(Iq)  proved  highly  successful  in  finding  a  good  two 
dimensional  representation.  The  term  good  implies 
sufficient.  A  sufficient  ratio  must  be  user  defined.  Figure 
4.4c  is  a  transformation  of  the  example  utilizing  R  = 
(40,1,6)  to  yield  a  il^)  =  .748836.  This  ratio  is  not 
minimal  but  certainly  can  be  preceived  as  sufficiently 
separating  the  classes. 

D.  SUMMARY 

The  location  of  reference  points  determine  the 
information  context  of  the  distance  space  representation. 
When  the  distribution  of  classes  within  pattern  space  is 
unknown,  an  iterative  technique  based  on  some  optimization 
criterion  can  be  utilized  to  locate  reference  points  which 
provide  sufficient  transformations. 


48 


300 


C\J 


a_ 


LU       200 


DC 


CVI 
X 
X 

LU 
C_) 
2: 

a: 
(— 
if) 


100. 


0. 


-o 


A 


A  A 


O 


O 


o 

I  0)   I 


CD 

O 


A  A 

A  A 

A  A 


A  A 


A 
A 


o 


o 


o 


o 


CD 


O 


o 


o 


o 


o 


I    I    >    I 


o 


I    I    I    I    I    I    I    I    I    I    I    I    I 


5.  10.  15  20.  25.  30.  35 


DISTnNCFxKc-'  FROM  ORIGIN 


Figure  4.4c   A  sufficient  ratio  transformation 
I3  =  1.699991      I2  =  .748836 
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V.   EVALUATION  PROCEDURE 

Two  different  experimental  procedures  were  employed  in 
evaluating  the  performance  of  this  dimensionality  reduction 
technique.  In  developing  this  procedure  the  initial  method 
was  to  locate  a  valid  reference  point  (R)  hefore  performing 
a  transformation.  This  was  done  to  ensure  the  transformation 
provided  a  unique  mapping.  After  deriving  an  analytical 
method  of  partially  hounding  the  locations  of  valid 
reference  points  this  method  was  reversed.  The  search  for  a 
sufficient  transformation  was  conducted  and,  if  required, 
followed  hy  a  validation  of  the  reference  point.  The 
validation  procedure  will  he  discussed  followed  hy  the 
sufficient  transformation  search  procedures. 

A.   REFERENCE  POINT  VALIDATION 

Assumption  three  of  section  3C  states  a  reference  point 
(R)  exists  which  will  manipulate  a  circle  of  intersection 
such  that  assumption  two  of  that  section  will  he  true  for 
all  lattice  points  In  the  pattern  space  defined  Dy 
assumption  one.  Without  a  closed  form  analylcal  derivation 
for  validating  reference  points  the  only  way  to  validate  a 
reference  point  was  to  transform  the  data  into  distance 
space  and  verify   a   unique  mapping   existed.   Confirmation 
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required  an  exhaustive  comparison  of  each  data  point  with 
every  other  data  point  to  prove  a  unique  mapping. 

The  computational  complexity  involved  in  performing 
reference  point  validation  increased  exponentially  as  the 
number  of  dimensions  in  pattern  space  increased  linearly. 
This  was  as  expected  hy  the  "curse  of  dimensionality". 

The  SEARCHR2  computer  program  contained  in  this  thesis 
is  an  implementation  of  equation  3.7.  This  algorithm 
computes  the  two  sets  of  constant  differences  ,  (D,.^-  D^^) 
and  (x  .  -  X.),  and  stores  them  in  array  data  structures.  The 
alternative  method  of  implementing  the  algorithm  would  be  to 
forego  the  arrays  and  compute  each  difference  as  it  is 
required . 

The  first  method,  computing  and  storing  the  differences, 
is  computationally  more  efficient  in  terms  of  execution  time 
when  more  than  one  candidate  reference  point  is  to  be 
verified.  This  is  because  the  difference  matrices  need  be 
computed  only  once.  The  tradeoff  for  execution  speed  is 
memory  storage.  The  memory  requirements  increase 
exponentially  as  the  number  of  dimensions.  The  memory 
requirements  can  be  decreased  to  some  extent  by  requiring  a 
symmetric  pattern  space.  The  differences  of  (x  .  -  x  .)  is  the 
negative  of  (x.-x.).  This  implies  only  (n  *  (n  -  1))  /  2 
differences  in  lieu  of  (n  )  differences  for  each  of  the  two 
types  of  differences  computed.  Table  5.1  vividly 
demonstrates  the  "curse  of  dimensionality"  and   its   effects 
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on   memory  storage  required  for  various  pattern  space 
configurations. 

Table  5.1  Memory  requirements  of  program  SEARCER2  for 
various  pattern  space  configurations. 


SIONS 

RANGE 

NUMBER 

oy 

TOTAL  MEMORY  REQUIRED 

LATTICE 

FOR 

BOTH  ARRAYS 

POINTS 

(BYTES) 

1 

0-5 

6 

120 

2 

0-5 

36 

5670 

3 

0-5 

216 

301860 

4 

0-5 

1296 

14265720 

In  this  table,  memory  requirements  for  the  difference  arrays 
are  based  on  the  FORTRAN  G  programming  language  as 
implementated  on  an  IBM  360/67.  Single  precision,  four  byte 
numerical  representation  is  assumed. 

The  memory  allocation  requirements  can  be  overcome  by 
computing  the  (n  *  (n  -  1))  /  2  differences  as  they  are 
required  within  the  program  flow.  However  the  execution  time 
will  dramatically  increase  as  the  pattern  space 
configuration  increases  in  dimension.  Only  by  optimizing  to 
the  greatest  extent  possible  might  an  acceptable  program 
execution  time  be  generated. 

The  need   for   this  algorithm  has  been  obviated  to  some 
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degree  "by  the  development  of  an  analytical  derivation  of  a 
minumim  bound  on  reference  points.  This  algorithrr  is  still 
required  when  validating  points  inside  the  minimum  bound  as 
noted  in  section  3C. 

An  alternative  to  circumvent  both  of  these  problems 
would  be  to  evaluate  a  reference  point  only  over  the  set  of 
known  data  samples  rather  than  an  exhaustive  pattern  space. 
This  technique  would  cure  the  curse  of  dimensionality  but 
would  not  guarantee  assumption  three  for  all  points  in 
pattern  space.  This  concept  might  be  suitable  in  low  noise 
si tuati  ons  . 

This  possibility  brings  to  light  the  consideration  that 
a  unique  mapping  may  not  necessarily  be  required.  What  would 
be  desirable,  but  much  more  difficult  to  define,  is  a 
transformation  which  does  not  permit  samples  from  different 
classes  to  map  into  the  same  feature  space  point. 

B.   TRANSFORMATION  EVALUATION 

The  study  of  transformation  effects  progressed  from 
simple  synthetically  derived  cases  in  two  and  three 
dimensions  into  complex  real  data  in  10  and  32  dimensions. 
All  cases  were  mapped  into  two  dimensional  distance  space. 
Research  was  first  performed  in  geometrically  conceivable 
spaces  in  an  attempt  to  gain  the  greatest  amount  of  insight. 
All   studies  were  performed  on  an  IBM  360/67.  Transformation 
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nurrerlcal  results  were  produced  as  well  as  two  dinensional 
Versatec  plots  of  the  resulting  distance  space 
representations . 

In  performing  the  various  case  studies  the  evaluation 
objectives  were  to  : 

1.  gain  an  understanding  of  transformation  effects; 

2.  confirm  that  the  (I  )  ratio  provided  a  valid  measure  of 

q 

transformation  performance; 

3.  determine  methods  of  locating  reference  points  which 
provide  a  sufficient  transformation; 

4.  show  that  real  data  can  he  successfully  transformed 
into  a  lower  dimensional  representation  and  still  retain 
information  context. 

Some  insight  gained  in  pursuing  objective  one  has  been 
detailed  in  chapter  IV.  Further  illustrations  will  he 
provided  in  the  following  chapter.  The  chapter  on  results 
will  document  the  usefulness  of  the  (Ig)  ratio  and 
acknowledge  some  of  its  weaknesses. 

The  methods  of  locating  sufficient  reference  points  were 
constantly  being  refined  in  processing  the  various  case 
studies.  Initially  it  was  thought  that  the  optimium 
reference  points  would  exist  only  along  an  axis.  This  is 
most  definitely  not  true.  The  search  procedure  evolved  into 
an  iterative  processing  method.  This  method  rated  various 
reference  points  solely  on  their  resulting  ( I^ )  value.  The 
procedure  was  to  minimize  the  ( I^ )  ratio  since   the   smaller 
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in   value   ( I  J  t  the  rrore  information  context  present  in  the 

feature  space   representation.   The  maximum   value   of   the 

magnitude  of  the  reference  vector  is  unbounded.  To  limit  the 

search   region  the  user  arbitrarily  selected  a  maximum  hound 

magnitude.  Utilizing  either  the  positive  or  negative   hound, 

a   single   component   of   the  reference  vector  was  varied  hy 

some  interval  to  the  opposite  hound  while  holding  all   other 

components   of   the   reference  vector  constant.  This  allowed 

the  user  to  observe  effects  of  various  values  of  this  vector 

component.  The  effects  were  judged  by  comparing  the   various 

values   of  ( T  )  generated.  The  minimum  (I  )  was  selected  and 
g  q 

the  procedure  started  again  with  a  smaller  interval  centered 
around  the  component  value  which  generated  the  minimal  (I  ). 
This  procedure  was  continued  until  a  minimal  (I  )  ratio   had 

q 

been  reached  with  that  component.  The  process  was  repeated 
for  each  component  in  the  reference  vector. 

For  simple  cases  of  three  or  four  dimensions 
combinations  of  two  or  three  minimal  component  values  were 
tested  with  all  other  values  held  constant.  This  test 
occasionaly  provided  useful  results  but  was  not  consistent. 
After  each  component  of  the  reference  vector  had  been  tested 
individually,  all  minimal  (I  )  producing  components  were 
combined  together  and  tested.  For  all  test  cases,  this 
procedure  always  yielded  the  lowest  (I  )  measure.  When  all 
( Iq )  measures  were  compared  against  their  plots  the  minimum 
(  Iq  )  always  had  the  "best"  appearing  plot  in  ter'"s  of   class 
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clustering  and  class  separation. 

As  of  this  report  this  iterative  processing  procedure  is 
the  rrethodology  recorrmended .  However,  this  procedure  is  not 
without  faults.  The  test  and  evaluation  procedure  requires 
testing  each  component  of  the  n  dirrensional  reference 
vector.  This  is  a  minor  Toother  in  low  dimension  pattern 
spaces  hut  becomes  quite  awkward  in  high  dimensional  spaces. 
The  3?  space  reference  vector  would  have  required  31 
computer  runs  to  claim  a  satisfactory  search  for  a 
sufficient  reference  point.  Secondly,  it  was  discovered,  not 
unexpectedly,  that  local  minima  of  (I  )  exist  within  the 
hounded  set  of  possible  reference  points.  At  oresent  there 
is  no  closed  form  solution  for  finding  the  optimal  reference 
point.  The  only  way  to  overco""e  problems  of  local  minima  is 
extensive  testing.  Thirdly,  if  a  sufficient  reference  point 
is  found  to  exist  below  the  minimum  boundary  for  reference 
point  two,  the  SEARCHR2  program  will  be  required  to  validate 
the  reference  point.  This  complicates  the  situation  even 
further  with  all  the  limitations  of  that  program. 

C.   Implementation  tradeoffs 

This  technique  provides  the  researcher  or  engineer  a 
choice  of  alternatives.  One  alterative  will  require  a 
certain  amount  of  not  inconsequential  tire  and  effort  to 
find  a  reference  point  or  points   to   provide  a   sufficient 
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distance  space  representation.  But  the  fruit  of  that  effort 
will  he  the  ability  to  perform  the  regaining  portions  of 
testing  and  training  in  distance  space.  Significant  here  is 
that  the  time  consuning  portion  of  the  effort  is  devoted  to 
the  training  phase.  This  is  typically  not  the  phase  which  is 
time  critical.  The  distance  space  representations  are  less 
computationally  complex.  Hence,  the  testing  phase  will 
benefit  from  the  reduced  complexity  with  decreased  execution 
times.  This  will  be  especially  useful  in  real  time  decision 
making  applications  where  the  testing  phase  is  time 
critical. 

The  second  alternative  is  to  forego  the  tire  comsuring 
effort  in  training  but  with  a  commensurate  increase  in 
computational  complexity  in  the  testing  phase. 

The  researcher  or  engineer  must  judge  which  is  the  most 
cost  effective  for  his  application.  The  following  chapter 
will  hopefully  provide  some  insight  into  what  is  required  if 
the  first  alternative  is  selected. 
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VI.   EVALUATION  BESULTS 

In  evaluating  the  transformation  seven  test  cases  were 
studied.  The  evaluation  proceeded  from  simple  three  space 
prohlems  to  a  complex  32  dimensional  real  data  problem. 
Discussion  of  each  case  comments  on  how  the  data  samples 
were  derived,  the  procedures  in  evaluating  the  case  studied, 
and  the  results.  Graphic  illustrations  are  provided  as 
appropriate.  The  appendices  contain  complete  documentation 
on  the  progression  of  testing  for  all  cases  studied. 

A.  CASE  1  :  A  THREE  CLASS  THREE  SPACE  PROBLEM 

A  simple  prohlem  was  first  attempted  to  gain  insight 
into  the  transformation  process.  Figure  6.1a  illustrates  the 
heuristically  derived  points  in  pattern  space.  Appendix  A 
contains  a  listing  of  the  points  which  make  up  each  class. 
The  transformation  was  from  three  space  to  two  space.  In 
three  space  (I  )  =  .2319393.  The  hest  (I  )  ratio  achieved, 
in  a  less  than  exhaustive  search,  was  0.07986128. 

Various  linear  comhinati ons  of  reference  point  twos  (R  ) 
were  tested  to  observe  the  transformation  effects  on  pattern 
space.  The  distance  space  representations  were  plotted  with 
the  X  axis  as  distance  to  the  origin  sauared  and  the  Y  axis 
as  distance  to  R   squared.  It   is   interesting  to   note   in 
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Figure   6.1a     A   three    class    three   space   problem 


I3   =    0.231939 


class    1      (    1,2,3,4   ) 
class    2      (    5,6    ) 
class    3      (    7,8,9,10    ) 
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figures  6.2b  -  f  the  results  developed  utilizing  various 
linear  combinations  of  an  R  point.  Observe  that  the 
relative  proximity  of  the  classes  is  unchanged  while  the 
relative  positions  within  the  classes  are  a  function  of  the 
reference  point  two  utilized  in  the  transf orrration.  This  is 
to  be  generally  expected  as  the  within  classes  relationships 
will  change  as  the  reference  point  two  changes.  This  is  also 
a  function  of  the  fact  that  the  distance  to  the  origin  never 
changes  while  the  (d2)  values  vary  as  the  (R2)  very. 

This  last  observation  suggest  an  examination  of  moving 
reference  point  one  from  the  origin  in  an  attempt  to  improve 
class  separation.  While  it  may  be  a  valid  concept  the 
transformation  becomes  much  more  complex  in  the  process. 
This  examination  is  suggested  as  a  topic  for  further 
research . 

B.   CASE  2  :  A  THREE  DIMENSIONAL  BISECTED  CUBE 

A  three  dimensional  cube  of  integer  lattice  points  was 
develoDed  for  this  study.  This  case  was  previousily 
discussed  as  the  geometrically  conceivable  example  in 
section  IV  C.  Figure  4.2  illustrated  the  three  space 
configuration  of  the  classes. 

This  case  has  some  interesting  complications.  In  pattern 
space  the  (I^)  ratio  is  1.699991.  The  class  means  are  : 
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Figure  6.1b   I^  = 


R^  = 


.096678 
(-1,1,6) 


Figure  6.1c 


I^  =  .094691 
R2  =  (6,1,-1) 


Figure  6. Id   I^  = 
R^  = 


.212315 
(-1,21,8) 


Figure  6 . le  1^   =    .080043 


R2  =  (6,-1,1) 


Figure  6. If 


I^  =  .079861 
R2  =  (1,-1,6) 


Variations  in  within  class  relationships  as  R^  changes 


I^  =  0.231939 
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(  X  ,  y  .   z  ) 

class  1  (  1.66,  3.33,  1.5  ) 

class  2  (  3.33,  1.66,  1.5  ). 

The  scatter  within  classes  (S^)  are  equal.  An  (I  )  ratio 
greater  than  one  implies  the  distance  between  the  two  class 
means  is  less  than  the  average  distance  between  a  class  rean 
and  the  samples  within  that  class.  Even  with  the  (I  )  ratio 
greater  than  one  there  exists  a  distinct  linear  separating 
"boundary  hetween  the  classes. 

Appendix  B  contains  a  listing  of  the  data  points  in  each 
class  and  a  summary  of  the  iterative  processing  steps  for 
this  case.  Ten  iterations  were  required  to  achieve  an 
"optimal"  value.  As  noted  in  chapter  IV  a  sufficient 
solution  was  obtained  on  the  fourth  iteration.  This 
demonstrates  the  value  of  having  a  two  dimensional  picture 
of  the  data  on  which  to  make  judgements  about  that  data. 

It  occured  to  this  researcher,  upon  examining  the 
results  of  iterations  six  and  seven  (see  appendix  3),  that 
the  minumum  value  was  symmetric  in  magnitude  in  the  X  and  Y 
components.  Iterations  7-12  attempted  to  exploit  this  fact 
by  testing  beyond  the  user  defined  bound  of  999  in  the  X  and 
Y  components  of  the  vector.  This  proved  quite  successful  as 
figure  4.3a  illustrated.  By  symmetrically  increasing  the 
values  of  the  X  and  Y  components  the  (I2)  ratio  was 
minimized.  As  reference  point  two  is  moved  further  from 
pattern   sDace   the   change   in   curvature   of   the   tangent 
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intersection  becomes  almost  nil.  This  occurs  because  the 
circle  of  intersection  begins  to  approximate  the  surface  of 
the  sphere  defined  by  the  (d2)  distance  as  shown  in  figure 
6.2.  In  effect,  this  forces  similar  points  to  map  almost 
linearly  into  distance  space.  This  fact  accounts  for  the 
apparent  subclusters  that  exist  in  each  of  the  classes. 

In  step  seven,  the  Z  components  were  varied  to  study 
their  effect  on  the  (I2)  ratio.  As  can  be  seen  from  the  data 
increasing:  Z  in  magnitude  above  one  adversely  affected  the 
( I  2)  ratio.  In  iterations  9, 10, and  11  note  that  symmetric 
points  in  the  X,Y  plane  yield  similar,  if  not  equal, 
results.  This  can  be  explained  by  realizing  that  the 
"direction"  of  the  circle  of  intersection  of  the  various 
symmetric  points  and  reference  point  one  are  very  nearly 
equal.  They  differ  in  that  the  P2  sphere  is  located  on  the 
opposite  side  of  the  R-^   sphere. 

This  case  study  proved  the  most  enlighting  as  to  the 
geometric  effects  of  passing  the  intersection  of  the  spheres 
through  pattern  space. 

C.   CASE  3  :  A  CUBE  WITHIN  A  CUBE 

This  case  was  selected  to  study  the  effectiveness  of 
using  the  (I„)  measure  in  a  complex  problem.  Two  cubes  were 
generated  in  a  three  dimensional  pattern  space  containing 
integer  lattice  points  in   the   range   (0,0,0)   to   (5,5,5), 
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Figure  6.2   Change  in  curvature  of  the  tangent  intersection 


pattern 
space 


case  1 


d  ^ 
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In  two 
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space  the 
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space  the  secant  line  of  intersection  begins 
approximate  the  curvature  of  the  circle 
As  R^  is  moved  away  from  pattern 
curvature  of  the  R2  circle  becomes 
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Appendix  C  contains  a  complete  listing  of  the  data.  The 
outer  cu^e  exhaustively  surrounded  the  inner  cube.  The  inner 
cube  mean  was  (3.0,3.0,2.5).  The  outer  cube  mean  value  was 
(2.84,2.84,2.5).  Thus  the  outer  cube  mean  value  was 
contained  inside  the  inner  cube.  The  three  space  (I3)  ratio 
was  2950.249.  The  "optimal"  (1 2)  ratio  was  66.218964.  Figure 
6.3a  is  the  resulting  two  space  representation.  The 
reference  point  two  which  yielded  this  result  was  (6,1,-1). 
A  listing  of  all  points  tested  is  contained  in  appendix  C. 

A  rore  visually  appealing  result  is  illustrated  in 
figure  6.3b.  Generated  from  R2  equals  (360,-60,1),  the  (I2) 
ratio  was  2574.547.  The  points  are  bunched  into  six 
clusters.  Each  group  of  points  can  be  characterizd  by  its 
location  on  the  Z  axis  in  the  three  space  representation. 
For  example,  the  group  located  nearest  the  X  axis  in  the  two 
space  representation  is  all  the  points  located  on  the  Z  =  0 
plane  in  three  space. 

This  example  provides  some  insight  on  how  the 
transformation  skews  pattern  space  into  distance  space.  In 
this  three  space  to  two  space  example,  the  perspective  is 
changed  much  like  an  artist  would  skew  an  image  to  provide  a 
three  dimensional  perspective  on  a  two  dimensional  canvas. 
This  suggest  there  may  be  some  applications  for  this 
transformation  in  the  field  of  computer  graphics. 
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Figure  6.3a  A  two  ciimensional  ciistance  space  representation 
of  a  three  ciimensional  cube  within  a  cube. 


I   =  2950.249 


I   =   66.218964 


66 


8000 


Figure  6.3b   A  visually  interpretable  two 


6000 


space  representation  of  a  three  space  cube 
within  a  cube. 

AAA  A 

AA     AAA  A 

AA     A  A  A  A 

^A     AAA  A 

AA     AAA  A 

AA     A  A  A  A 


A  A 


C\l 


A      0        o 

A 


AA     A  A 


A 
A 


A     A 


Qz     yooo 


A      O        O 

A      O        o 

A       O 


AA     A 


A     A 

A 

A 


A        O  O 

A 


AA     A 


A 
A 


2000 


A     A 

"a 

A 


AAA  A 

AAA  A 

A      A  A 

A      A 


A 
A 


0. 


A     Al 


0. 


^0 


60. 


80. 


DlS"^RNLExx,::    FRUM    ORIGIN 


67 


D.   CASE  4  :  THHEE  SPACE  SERIES  OF  CONVERGING  CLASSES 

This  study  was  a  series  of  five  cases  in  three 
dimensional  space  in  a  lattice  containing  all  integer  points 
from  (0,0,0)  to  (24,24,24).  The  cases  differ  by  the  relative 
location  of  the  two  classes  in  space.  The  data  points  for 
the  two  classes  were  generated  on  a  Texas  Instrurrents  TI-59 
calculator  using  the  random  number  generator  program 
(ML-15).  The  class  one  seed  was  2135.  The  class  two  seed  was 
7540.  The  standard  deviation  used  was  2.0.  These  parameters 
were  kept  constant  across  the  experiment  so  that  the  only 
parameters  of  variability  were  the  distance  between  classes 
and  reference  point  two.  Table  6.2  contains  the  mean  samples 
generated  for  each  class. 

Table  6.2   Sample  means  for  three  space  series  of  converging 
classes 

case  class  1  mean  class  2  mean 

X  y  2  X  y  z 

1  (  4.25,  3.41,  3.08  )  (  20.16.  19.67,  19.58  ) 

2  (  6.08,  5.41,  5.08  )  (  18.33,  18.50,  17.66  ) 

3  (  8.00,  7.50,  7.03  )  (  16.33,  16.50,  15.67  ) 

4  (  9.16,  9.41,  9.08  )  (  14.33,  14.50,  13.66  ) 

5  (  12.08,  11.41,  11.08  )  (  12.33,  12.50,  11.67  ) 

This  study  was  two  fold  in  purpose.  One  goal  was  to 
observe  the  effects   on   selection   of   R2  as   the   classes 
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approached  one  another.  Secondly,  an  attempt  was  irade  to 
distinguish  where  the  transformation  would  not  longer 
separate  classes. 

As  before  all  cases  were  processed  using  the  systematic 
iteration  procedure  delineated  in  the  previous  chapter.  The 
following  results  were  obtained. 


Table  6.3     I g  results  for  three  space  converging  classes 


case     I  3      I2  reference  point   iterations  figure 

1  0.061068  0.014587  (  66,  66,  66  )       5      6.4a 

2  0.106720  0.027066  (  63.  63,  63  ) 

3  0.238156  0.47232  (-99,-540,-99) 

4  0.813121  0.153407  (-99,-540,-99) 

5  32.466873  4.560885  (-150,-900,-150^ 

Cases  one  and  two  share  similar  reference  points  as  do 
cases  three  and  four.  Unfortunately,  there  is  not  enough 
samples  here  to  rationalize  why  this  is  so.  Since  the 
classes  vary  between  cases  only  by  their  separation  then  it 
will  said  that  the  relative  proximity  between  classes  does 
affect  the  choice  of  R  2.  In  case  five,  the  classes  shared 
the  same  mean.  They  were  highly  interleaved  as  shown  by  the 
I  3  ratio  of  32.466873.  The  change  in  the  I  2  ratio  is  a 
measure   of   how  much  deinterleavlng   took   place   in   the 
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Figure  6 . 4a    Two  space  solution  to  case  1 
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Figure  6.4b    Two  space  solution  to  case  2 
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Figure    6.4c        Two   space   solution   to   case    3 
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Figure  6.4d   Two  space  solution  to  case  4 
I   =  .813121     I2  =  .153407 
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Figure  6.4e   Two  space  solution  to  case  5 
I   =  32.466873  1^   =    4.560885 
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transformation.  Case  five  further  supports  the  premise  that 
the  relative  proximity  of  the  three  space  data  was 
maintained  in  that  total  deinterleaving  did  not  occur.  This 
technique  claims  to  only  enhance  separation  present  in 
pattern  space  in  the  distance  space  representations.  To 
further  comment  on  the  behavior  of  R2  will  require  a  more 
exhaustive  examination  of  its  performance  under  similar 
situations . 

E.   CASE  5  :  TEN  SPACE  SERIES  OF  CONVERGING  CLASSES 

This  study  is  a  series  of  four  cases.  Pattern  space  is  a 
ten  dimensional  integer  lattice  containing  all  points  from 
the  origin  to  (19,19,19,19,19,19,19,19,19,19).  Two  classes 
were  generated  in  each  case.  The  samples  were  synthetically 
derived  using  the  IBM  360/67  and  utility  program  LLRANDCM 
entry  point  NORMAL.  The  seeds  were  held  constant  for  each 
class  over  all  four  cases.  The  variance  selected  was  2.0. 
The  following  means  were  generated  for  each  of  the  classes. 
Read  a  class  mean  vector  as  a  column  in  the  tahle. 

Table  6.4   Sample  means  for  ten  space  series  of  converging 
classes 


case 
class 


4.12    15.43  5.12    14.56  8.62    12.06        9.81    10.06 
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3.18  15.68 
4.06  15.43 
4.56  16.50 
2.93  15.93 
4.50  15.37 
4.25  16.18 
3.81  16.37 
3.75  17.00 
4.00    16.12 


6.00  15.12 
5.50  13.31 
6.18  14.06 
6.73  14.56 
5.75  14.06 
5.81  14.25 
5.62  13.50 
6.18    13.81 


8.43    12.62  9.75    10.06 

8.06    12.43  10.31    10.06 

8.06    12.43  10.31    10.06 

8.06   11.93  9.93      9.78 

8.12    12,31  10.31      9.87 

8.62    12.18  10.37      9.12 

8.06   12.00  9.93      9.06 

7.56    11.62  9.62      9.18 

8.00    12.37  10.18      9.75 


6.43  14.37 

The  goals  of  tills  study  are  siniler  to  the  previous 
study  in  three  dimensions;  to  ohserve  the  "behavior  of  R2  as 
the  classes  approached  one  another  and  to  attempt  to 
distinguish  when  the  transformation  would  no  longer  separate 
classes.  The  results  obtained  are  detailed  in  table  6.5. 


Table 

6.5       Iq 

results  f 

case 

^10 

H 

1 

0.069465 

0.004561 

2 

0.158126 

0.023578 

3 

0.594771 

0.062027 

4 

36.600388 

8.294548 

iteration  figure 

1  6.5a 

1  6.5b 

1  6. 5c 

8  6.5d 


The  I   results  were  obtained  with  the  following  reference 
points: 
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Table  6.6    Sufficient   reference  points   for   ten   space 
converging  classes 

case  reference  point  two 

1  (   51,   52,   53,   54,   55,   56,   57,   58,   59,   60) 

2  (-501  ,-502,-503,-504,-505,-506,-507,-508.-509,-510) 

3  (-501 ,-502,-503,-504,-505 ,-506,-507,-508,-509,-510) 

4  (  999,  800,-821,-219,-111,  900,-999,-411,-511,-611) 

In  observing  that  only  one  iteration  was  required  to 
find  a  sufficient  separation,  it  can  be  said  that  the 
inherent  separation  in  the  data  allowed  a  wide  choice  cf  R2 
to  provide  a  sufficient  transf orrration.  It  is  interesting  to 
note  that  cases  two  and  three  utilized  the  same  reference 
point.  This  is  the  same  occurance  as  with  the  three  space 
study.  In  both  studies  the  reference  points  for  the 
noninterleaved  cases  were  not  near  the  sufficient  solution 
reference  points  for  the  interleaved  cases. 

The  transformation  had  no  problem  maintaining  or 
enhancing  the  inherent  separation  in  the  data.  Only  in  the 
overlapping  case  was  an  I2  <  1  not  achieved.  However,  a 
significant  reduction  in  the  I  ratio  was  achieved  in  all 
cases. 

In  the  fourth  case  of  this  study  the  adrrinstrative 
complexity  of  high  dimensional  data  became  a  burden.  To 
allow   sampling   over   all   elements   of   the   E2  vector  ten 
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iterations  should  "be  required.  In  the  evaluation  only  eight 
were  performed  as  modifying  the  individual  components  of  the 
reference  vector  became  unwieldy.  The  burden  could  be 
essentially  overcome  with  a  more  automated  test  procedure  at 
the  cost  of  more  computer  execution  time. 

G.   CASE  6  :  TEN  SPACE  THREE  SHI?  RADAR  TARGET  RECOGNITION 
DATA 

This  study  was  conducted  to  observe  the  performance  of 
the  transformation  on  real  data  in  high  dimensions. 

The  data  was  collected  by  the  Naval  Weapons  Center, 
China  Lake,  California  as  part  of  a  research  effort  on  radar 
ship  classification  techniques.  The  samples  consisted  of 
radar  profiles  of  selected  ships.  The  samples  experienced 
some  preprocessing  prior  to  being  input  to  the 
dimensionality  reduction  technique.  The  received  radar 
echoes  were  taken  from  the  radar  receiver  and  fed  through  an 
analog-to-digital  converter  and  eventually  stored  on 
magnetic  tape.  The  remaining  preprocessing  is  shown  in 
figure  6.6. 

The  samples  were  gathered  in  512  dimensional  space.  For 
the  purposes  of  this  study  only  the  first  ten  components  of 
each  sample  were  utilized.  When  received  from  NWC  the 
samples  ranged  in  value  from  -8.0  to  1.0.  To  meet  the 
assumption  that  the  data  exist  in  a  lattice  pattern  space  it 
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Figure  6.6   Preprocessing  flowchart 
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was  scaled  Into  an  integer  space  ranging  from  0  to  300  in 
each  corrponent.  Each  real  number  component  was  scaled  with 
the  following  procedure  : 

1.  add  8.0 

2.  multiple  by  32.0 

3.  add  0.5 

4.  truncate  the  fractional  part. 

Appendix  F  contains  the  resulting  samples  and  the  iterative 
processing  results.  In  the  first  case  of  this  study  each 
class  contained  16  samples. 

The  ten  space  data  had  a  (I^o^  ratio  of  3.750768.  The 
sufficient  ( I2 )  ratio  was  .189089  when  processing  ceased. 
Twelve  iterations  were  required  to  achieve  this  result. 
Figure  6.7a  is  the  two  space  result  of  the  transformation. 

The  iterative  processing  technique  proved  effective. 
After  identifying  the  "best"  value  for  each  component  of  the 
reference  vector  in  iterations  1  -  11,  the  "best"  value  for 
each  component  was  placed  into  a  single  vector.  This  step 
yielded  a  result  of  0.442269  and  figure  6.7b.  In  examining 
each  of  the  components  of  the  mean  sample  for  each  of  the 
classes  it  was  observed  that  the  components  with  the  most 
variability  between  classes  developed  I  minimizing 
reference  point  components  which  were  not  near  the  user 
defined  bounds  of  plus  or  minus  (9999,9999, ... ,9999 )  .  In 
this  study  components  one,  two,  and  three  of  the  sample  mean 
vectors  exhibited  this  behavior.   The   remaining   components 
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had  miminal  variation  of  mean  component  values  between 
classes.  The  remaining  components  venerated  reference  point 
two  component  values  at  the  user  defined  bounds,  -9999  or 
9999. 

In  making  these  observations  it  was  decided  that  the 
"best"  value  for  those  components  with  values  at  the  bound 
had  not  reached  the  minimum  (I2 )  for  that  element.  These 
particular  values  were  increased  by  a  factor  of  ten  and 
tested  again.  This  was  the  vector  which  generated  the 
minimum  (12)-  This  behavior  is  similar  to  that  documented 
for  the  X  and  Y  components  of  the  bisected  cube  problem. 

After  determining  the  reference  point  two  which  yielded 
the  lowest  {I2 )  over  the  48  sample  set  it  was  decided  to 
test  the  entire  set  of  training  samples.  The  training 
samples  consisted  of  423  samples  divided  into  three  classes. 
Class  one  contained  141  samples.  Class  two  consisted  of  137 
samples.  Class  three  had  145  samples.  Two  reference  points 
were-  tested.  The  first  was  the  value  determined  for  the  43 
sample  set.  The  second  point  was  similar  to  the  first  but 
with  the  negative  -9999  components  increased  by  a  factor  of 
ten.  The  following  results  were  obtained. 

Table  6.7  Ten  space  ship  profiles  reference  points 


reference  point 

(-3000, -450(?  ,-7000  ,-9999,-9999  , 
99999,99999,99999,99999,99999) 


1.57816? 


figure 
6. 7c 
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( -3000 , -4500 , -7000 , -99999 , -99999 , 

99999,99999,99999,99999,99999)        1.310979       6.7d 


Figure  6.7e  is  an  enlargen^ent  of  the  heavily  clustered  area 
of  figure  6.7c.  While  there  is  a  large  amount  of  noise 
present,  as  would  he  expected  in  real  data,  the  claim  will 
be  rnade  that  three  distinct  clusters  of  data  exist,  one  for 
each  class  of  ship.  Figure  6.7f  is  an  enlargement  of  figure 
6.7d.  The  same  claim  regarding  clustering  is  made  for  this 
representation  also. 

G.   CASE  7  :  32  SPACE  THREE  SHIP  RADAR  TARGET  RECOGNITION 
DATA 

This  study  is  a  continuation  of  the  previous  study  in  a 
higher  dimension  space.  The  same  ship  profiles  were  utilized 
with  32  components  per  sample  instead  of  ten.  The  samples 
were  scaled  in  the  same  manner  as  the  ten  space  samples. 
Appendix  G  contains  the  references  points  tested  in  the 
iterative  processing  and  the  sample  means  for  each  of  the 
classes.  The  samples  are  not  listed  due  to  their  large 
number. 

The  two  space  representation  of  32  dimensional  samples 
in  figure  6,8  exhibits  much  similarity  to  the  ten  space 
representation  in  figure  6.7c.  The  general  location  of  the 
three  ship  classes  is  unchanged  between  the  two  figures.  The 
reference  point  which  generated  the  0.189087  (I2)  ratio  for 
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Figure  6.7f 
Enlargement  of 
figure  6.7d. 
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the  ten  space  study  was  utilized  as  the  first  ten  corrponents 
of  the  32  space  vector.  Sixteen  iterations  were  required  to 
test  the  first  24  corrponents  of  the  reference  vector.  The 
minimum  (I2)  ratio  obtained  was  1.624708.  The  32  space  (I32) 
was  3.607182.  The  similarity  between  the  32  end  10  space 
representations  is  as  much  as  result  of  the  data  as  the 
transformation.  A  discussion  of  the  data  and  its  meaning  is 
beyond  the  scope  of  this  thesis.  Th«='  claim  is  again  made 
that  the  two  space  representation  contains  three  distinct 
clusters,  one  per  ship. 

H.   CASE  STUDIES  SUMMARY 

A  series  of  seven  cases  have  been  tested.  The  studies 
highlight  various  effects  found  in  the  transformation 
process.  The  simple  three  class  three  space  problem 
illustrated  the  changing  relationship  of  data  within  classes 
when  R-,  is  fixed  at  the  origin  and  R2  is  moved  around.  The 
bisected  cube  provided  insight  into  how  the  curve  of 
intersection  passed  through  pattern  space.  It  further 
demonstrated  geometrically  how  the  curve  of  intersection 
should  cross  pattern  space  to  achieve  the  greatest  amount  of 
class  clustering.  The  cube  within  a  cube  example  was 
utilized  to  study  the  use  of  the  (I  )  measure  in  a  complex 
problem.  The  (I  )  ratio  was  shown  to  yield  good  results  when 
used  as  an  optimization   criterion.   However,   it   was   also 
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shown  that  when  different  goals  are  desired  (graphical 
display)  (I  )  may  not  be  the  best  method  of  achieving  that 
objective.  The  three  and  ten  space  converging  class  studies 
demonstrated  that  as  long  as  some  separation  existed  between 
classes  that  separation  could  be  enhanced  in  the  lower 
dimensional  representation.  They  further  illustrated  that 
the  transformation  will  not  remove  class  interleaving 
inherent  in  pattern  space  representations.  Stated 
differently,  the  general  relationships  which  exist  in 
pattern  space  will  be  retained  in  the  distance  space 
representation.  These  two  cases  demomstrated  that  the 
transformation  process  can  function  effectively  in  a  noisy 
environment. 
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VII.   CONCLUSIONS 

A  nonlinear  transformation  has  been  developed  which 
retains  or  improves  relative  proximity  of  sirilar 
information  while  significantly  reducing  the  representations 
of  data  for  several  specific  cases.  These  studies  have  shown 
the  feasibility  of  this  technique.  They  support  the 
supposition  that  this  transformation  is  a  valid  process 
suitable  for  general  applications  of  dirrensi  onali  ty 
reduction. 

The  concept  of  information  context  is  valid.  3y 
representing  in  m  dimensional  space  the  relative 
relationships  of  data  in  n  dimensional  space,  rather  than 
the  data  itself,  there  is  essentially  no  loss  of  contextual 
information  in  the  lower  dimensional  representation. 

A.   HECOMMENDATIONS  TOR  CONTINUED  RESEARCH 

1.  First  and  foremost  is  testing  the  reduced 
representations  in  a  pattern  classification  algorithm.  To 
truly  Judge  this  an  effective  technique  the  pattern 
classification  results  must  yield  equal  or  better  results 
than  the  classification  results  obtained  with  the  n 
dimensional  data. 

2.  Development   of   a   better  method  of  efficiently  and 
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rapidly  locating  optimal"  reference  points  is  critically 
needed.  The  current  methods  will  "become  unworkable  as  higher 
dimension  spaces  are  tested.  The  method  could  he  some  closed 
form  analytically  derivable  result  or  an  iterative  search 
computational  method. 

3.  High  dimensions  should  be  explored  to  observe  any 
effects  which  may  present  themselves. 

4.  The  minimum  bound  on  the  lattice  point  interval 
should  be  determined.  This  researcher  feels  it  will  be  the 
smallest  interval  which  will  still  uniquely  represent 
information  at  the  desired  level  of  accuracy.  As  an  example 
for  single  precision  FORTHAN  on  the  IBM  360  (7.5  digits 
accuracy)  if  the  interval  is  0.0001  then  all  points  in 
pattern  space  must  be  capable  of  being  uniquely  represented 
within  the  remaining  3.5  digits  of  accuracy.  A  second  bound 
on  the  lattice  interval  will  be  the  discretization  process. 
If  an  analog-to-digital  converter  collects  eight  bits  of 
information  then  those  bits  define  the  information  cells  of 
the  lattice. 

5.  Different  measures  of  information  context  needed  to 
be  derived  and  compared  to  the  current  definition.  Is  the 
concept  of  measuring  localized  distance  as  defined  by  Meisel 
[2]  a  valid  measure?  Duda  and  Hart  [l]  also  suggest  several 
alternative  measures. 

6.  The  effect  of  assigning  to  reference  point  one  values 
other  than  the  origin  should  be  studied. 
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7.  Is  there  any  significant  advantage  to  mapping  through 
a  series  of  distance  spaces  to  further  enhance  relative 
proximity?  This  could  be  done  by  one  mapping  to,  for 
example,  two  space  followed  by  several  two  space  to  two 
space  transformations.  A  second  method  would  be  to  map  from 
n  space  to  n  -  1  space  to  n  -  2  space  to  ...  to  two  space. 

8.  Given  that  the  data  can  be  uniquely  mapped  into  one 
dimension,  can  a  reverse  transformation  be  foun.d  to  return 
the  data  to  n  dimensions?  This  question  is  complicated  by 
the  fact  that  the  solution  exist  in  noncontinuous  space. 
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APPENDIX  A   TEST  DATA  FROM  CASE  STUDY  1 


A.   SAMPLE  DATA 


Sampl* 


Class 


Index  num"ber 


1.  1,  1 

1,  3,  2  ) 

2,  1,  3  ) 

3.  2,  1  ) 

4.  4,  4  ) 

3,  4,  4  ) 
6,  5,  4  ) 

4,  5.  6  ) 
6,  4,  5  ) 

5,  4.  6  ) 


1 
1 
1 
1 
2 
2 
3 
3 
3 
3 


1 
2 
3 
4 

5 
6 
7 

8 

9 
10 


B.   REEEEENCE  POINT  TEST 


1. 


REFERENCE  POINT 
ITERATION  1 


(  -  1, 

6  ) 

.0966678 

(      6, 

1 ,  - 

1  ) 

.0946914 

(  -    1, 

21. 

8  ) 

.2123157 

(      6,  - 

1  ) 

.0800436 

(      1.  - 

6  ) 

.0798612 
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APPENDIX  B   TEST  DATA  FROM  CASE  STUDY  2 


A.   SAMPLE  DATA 


Sample 


Class 


2, 

0    ) 

,    2, 

.    1    ) 

2, 

2    ) 

»    2, 

,    3    ) 

3, 

0    ) 

r      3, 

1     ) 

»    3, 

2    ) 

3, 

3    ) 

4, 

0    ) 

.    4, 

»    1    ) 

4, 

2    ) 

»    4, 

3    ) 

(    2, 

»    4, 

.    0    ) 

(    2, 

,    4, 

1    ) 

(    2, 

.    4, 

,    2    ) 

(    2, 

r     4, 

»    3    ) 

(    2, 

,    3, 

,    0    ) 

(    2, 

.    3, 

,    1    ) 

(    2, 

,    3 

,    2    ) 

(    2, 

,    3, 

,    3    ) 

(    3, 

»    4, 

,    0    ) 

(    3, 

»    4, 

r    1    ) 

(    3, 

r     4, 

»    2    ) 

(    3, 

,    4, 

»    3    ) 

(    2 

,    0    ) 

(    2 

»    1    ) 

(    2 

f    2    ) 

(    2, 

,    3    ) 

(    3 

►    0    ) 

(    3 

,    1    ) 

(    3 

r     2      ) 

(    3 

►    3    ) 

(    3 

'    2, 

,  0  ) 

(    3 

►    2 

r  1  ) 

(    3 

»    2 

»    2    ) 

(    3 

»    2 

»    3    ) 

(    4 

,    3 

,    0    ) 

(    4 

,    3 

,    1    ) 

2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 


100 


(  4, 

3, 

2 

) 

{  4, 

3, 

3 

) 

(  4, 

2, 

0 

) 

(  4, 

2, 

1 

) 

(  4, 

2, 

2 

) 

(  4, 

2, 

3 

) 

(  4, 

1, 

0 

) 

(  4, 

1, 

1 

) 

(  4, 

1, 

2 

) 

2 
2 
2 
2 
2 
2 
2 
2 
2 


B.   REFERENCE  POINT  TEST 


REFERENCE  POINT 


12 


3. 


ITERATION  1 

(  -   1. 

1, 

6  ) 

18.244934 

(      6, 

- 

1. 

1  ) 

1.575197 

(  -   1, 

21, 

8  ) 

.676884 

(      6, 

- 

1. 

-   1  ) 

.632244 

(      1, 

— 

1, 

6  ) 

18.244934 

ITERATION  2 

(     21, 

_ 

1, 

18  ) 

1.534258 

(  -    1. 

18, 

21  ) 

2.392746 

(     21, 

18, 

-   1  ) 

80.819992 

(     18, 

21, 

-   1  ) 

80.819992 

(     18. 

- 

1. 

21  ) 

2.392746 

(  -   1, 

12, 

15  ) 

2.391603 

(  -   1. 

15, 

12  ) 

1.246020 

(     12, 

- 

1. 

15  ) 

2.391603 

(     15, 

- 

1. 

12  ) 

1.266020 

(     12, 

15, 

-   1  ) 

36.019989 

(     15, 

12, 

-   1  ) 

36.019989 

(      8, 

- 

1, 

1  ) 

.491111 

(     10, 

- 

1. 

1  ) 

.454380 

(     14, 

- 

1, 

1  ) 

.464600 

(     20, 

— 

1, 

1  ) 

.514694 

Iteration  3 

(    13, 

— 

1. 

1  ) 

.458060 

(     12, 

- 

1. 

1  ) 

.453136 

(     15, 

- 

1, 

1  ) 

.472577 

(     16, 

- 

1. 

1  ) 

.480899 

(     17. 

- 

1, 

1  ) 

.489444 

(     18, 

- 

1. 

1  ) 

.498007 

(     19, 

- 

1, 

1  ) 

.506450 

101 


16, 
18, 
19, 
20, 

21, 
12, 
14, 
16, 
18, 

20, 
40, 
40, 


2 

1 


2 
2 
2 
2 
2 
3 
3 
3 
3 
3 
6 
6 


.480899 
.498007 
.506450 
.514694 
.522686 
.474437 
.480800 
.493355 
.507979 
.522857 
.602823 
.746836 


Iteration  4 


12, 
12, 
12, 
12, 
12, 
12, 


«^ , 

4, 

6, 

12. 

15, 

20, 


.336800 
.303828 
.267222 
.262812 
.281728 
.319706 


Iteration  5 


12, 
12, 
12, 
12, 
12, 
12, 


13, 

14, 
16, 
17, 
90, 
99, 


.268448 
.274821 
.289005 
.296527 
.599325 
.613893 


Iteration  6 


(  - 

(  - 

(  - 

(  - 

(  - 


12, 
12, 
12, 
12, 
12, 


12, 
12, 
12, 
12, 
12, 


2  ) 

7  ) 

13  ) 

21  ) 

27  ) 


.262812 

.356562 

.675312 

1.450312 

2.294062 


7.   Iteration  7 


(  - 

(  - 

(  - 
( 

(  - 

(  - 


12. 
12, 

50, 
50, 
99, 
99, 
99, 


12, 
12, 

50, 
50, 
99, 
99, 
99, 


3 

5 
3 
5 
1 
10 
10 


.269062 
.300312 
.203979 
.205779 
.200923 
.204229 
.207513 


8.   Iteration  6 


102 


9. 


10 


11 


(     99, 
(    150. 
(    200, 
(  -  150, 
(  -  200, 
(  -   99, 
{  -   50, 
(     50, 

- 

99. 

150, 

200, 

150, 

200, 

99, 

50, 

50, 

3 
1 
3 

) 
) 
) 
) 
) 
) 
) 
) 

Iteration  9 

(   300, 
(   300, 
(  -  300, 
(  -  300. 

- 

300, 
300, 
300, 
300, 

1 

3 

5 

30 

) 
) 
) 
) 

Iteration  : 

L0 

(    350, 
(  -  400, 
(  -  500, 
(  -  500, 
(  -  400, 

350, 
400, 
500, 
500, 
400, 

1 
1 

1 
100 

100 

) 
) 
) 
) 
) 

Iteration  : 

11 

(   600, 
(  -  700, 
(   800. 
(  -  999, 
(    999, 

- 

600, 
700, 
800, 
999, 
999, 

1 

3 

1 
1 
3 

) 
) 
) 
) 
) 

.200923 
.200402 
.200232 
.200402 
.200232 
.200923 
.201015 
.203619 


.200100 
.200110 
.200160 
.204160 


.200077 
.200053 
.200038 
.217502 

.227340 


.200025 
.200016 
.200191 
.200012 
.200012 
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APPENDIX  C  TEST  DATA  EROM  CASE  STUDY  3 


A.   SAMPLE  DATA 


Sarrple 


Class 


(    3, 

3, 

2    ) 

(    3, 

3, 

3    ) 

(    3. 

2, 

2    ) 

(    3. 

2, 

3    ) 

(    3. 

4, 

2    ) 

(    3. 

4, 

2    ) 

{    3, 

4, 

3    ) 

(    4, 

3, 

2    ) 

(    4, 

3, 

3    ) 

(    2, 

3. 

3    ) 

(    2. 

3. 

2    ) 

\    1  ♦ 

1, 

0    ) 

\    •*• » 

2, 

0    ) 

\    •»•  t 

3, 

0    ) 

\    -^  t 

4, 

0    ) 

V       i-  t 

5, 

0    ) 

(    2, 

1, 

0    ) 

(    2. 

2, 

0    ) 

(    2, 

3, 

0    ) 

(    2, 

4, 

0    ) 

(    2. 

5. 

0    ) 

(    3. 

1, 

0    ) 

(    3. 

2, 

0    ) 

(    3. 

3, 

0    ) 

(    3. 

4, 

0    ) 

(    3, 

5. 

0    ) 

(    4. 

1, 

0    ) 

(    4. 

2, 

0    ) 

(    4, 

3, 

0    ) 

(    4, 

4, 

0    ) 

(    4, 

5, 

0    ) 

(    5, 

1. 

0    ) 

(    5. 

2, 

0    ) 

(    5, 

3, 

0    ) 

(    5, 

4. 

0    ) 

(    5, 

5, 

0    ) 

(    1. 

1, 

5    ) 

(    1. 

2, 

5    ) 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 
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(  1 

,    3 

,    5    ) 

(  1 

f    4, 

»    5    ) 

(  1 

,    5 

,    5    ) 

(    2, 

,    1, 

►    5    ) 

(    2, 

,    2 

,    5    ) 

{    2, 

r     3, 

,    5    ) 

(    2, 

»    4, 

»    5    ) 

(    2, 

,    5, 

»    5    ) 

(    3 

,    1 

f   5    ) 

(    3, 

,    2 

.    5    ) 

(    3, 

»    3 

►    5    ) 

(    3, 

»    4, 

>    5    ) 

(    3, 

,    5, 

►    5    ) 

(    4, 

1, 

,    5    ) 

(    4, 

.    2, 

,    5    ) 

(    4, 

5    ) 

(    4, 

4, 

5    ) 

(    4, 

5, 

K       \ 

(    5, 

1, 

5    ) 

(    5, 

2, 

5    ) 

(    5 

3, 

5    ) 

(  s! 

4, 

5    ) 

(    5, 

5, 

5    ) 

(    0, 

.    1, 

(    0, 

2, 

(    0, 

3, 

(    0, 

4, 

(    0, 

►    5, 

(    0. 

1, 

2    ) 

(    0, 

.    2, 

,    2    ) 

(    0. 

.    3, 

,    2    ) 

(    0, 

>    4, 

,    2    ) 

(    0, 

.    5, 

.    2    ) 

(    0, 

•    1, 

,    3    ) 

(    0, 

2, 

,    3    ) 

(    0, 

»    3, 

,    3    ) 

(    0, 

4, 

3    ) 

{    0, 

.    5, 

,    3    ) 

(    0, 

.    1, 

,    4    ) 

(    01 

.    2, 

,    4    ) 

(    0, 

r    3, 

,    4    ) 

(    0, 

-    4, 

,    4    ) 

(    0, 

.    5, 

,    4    ) 

(    5, 

.    1, 

(    5 

,    2 

(    5, 

,    3, 

(    5 

,    4 

(    5 

r    5 

(    5 

,    1 

\    2    ) 

(    5, 

r     2, 

,    2    ) 

(    5 

►    3 

►    2    ) 

2 

2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 


105 


{h 

»    4, 

:l] 

5, 

(    5, 

1, 

,    3    ) 

(    5, 

2, 

3    ) 

(    5, 

3, 

3    ) 

(    5, 

4, 

3    ) 

(    5, 

5, 

,    3    ) 

(    5, 

1, 

4    ) 

(    5, 

2, 

,    4    ) 

(    5, 

,    3, 

,    4    ) 

(    5, 

>    4, 

,    4    ) 

(    5, 

5, 

4    ) 

(    1, 

,    5, 

,    4    ) 

(    2, 

5, 

»    4    ) 

{    3, 

,    5, 

►    4    ) 

(    4, 

,    5, 

,    4    ) 

(    5, 

,    5, 

»    4    ) 

(    li 

,    0 

,    4    ) 

(    2, 

,    0 

r     4      ) 

(    3, 

0, 

»    4    ) 

(    4, 

,    0 

,    4    ) 

(    5, 

,    0, 

»    4    ) 

(    1, 

.    0 

(    2, 

,      0 

(    3, 

,     0 

(    4, 

►     0 

(    5, 

,      0 

(    1, 

>     0 

\    2    ) 

(    2, 

.     0, 

►    2    ) 

(    3 

,      0 

►    2    ) 

(    4, 

r      0 

,    2 

(    5, 

•      0 

,    2    ) 

(    1, 

.    5, 

(    2, 

»    5 

(    3, 

,    5 

(    4, 

,    5 

{    5, 

>    5, 

(    1, 

,    5 

\    2    ) 

(    2, 

»    5 

r    2    ) 

(    3 

,    5 

►    2    ) 

(    4, 

,    5 

»    2    ) 

(    5 

,    5 

.    2    ) 

(    1, 

►    0 

f    3    ) 

(    2, 

»    0, 

r      3      ) 

(    3 

r    0 

,    3    ) 

{    4 

.    0 

►    3    ) 

(    5 

,    0 

,    3    ) 

(    1, 

»    5 

,    3    ) 

(    2 

r    5 

r     3      ) 

(    3, 

f    5, 

f    3    ) 

(    4 

r      5 

►    3    ) 

2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
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(  5.  5,  3  )  ; 

B.  REFERENCE  POINT  TEST 

REFERENCE  POINT 
1. 


ITERATION  1 

(     21.  - 

01. 

18 

(  -    1, 

18. 

21 

(     21, 

18. 

-   1 

(     18. 

21. 

-   1 

(     18.  - 

1. 

21 

2.  ITERATION  2 


506.106934 
560.919434 
274.874023 
274.874023 
560.919434 


[     13. 

- 

)          165.419464 

:      12, 

- 

>          148.707962 

[     15. 

- 

)          200.934296 

[     16. 

- 

)          219.47601? 

[     17. 

- 

1          238.391846 

[     18. 

- 

)          257.587891 

[     19, 

- 

I          276.977295 

:     16, 

— 

2  ' 

>          217.550034 

(     18, 

- 

2 

>          255.603177 

[     19, 

- 

2 

)          275.258789 

[     20, 

- 

2  ^ 

1          294.842041 

[     21. 

- 

2 

)          314.477763 

i           12. 

- 

3  ' 

1          146.451431 

:      14, 

- 

3  ' 

)          180.792053 

[     16. 

- 

3 

)          217.550156 

[     16. 

- 

3 

)         255.803207 

:      20, 

- 

1          294.842041 

;      40, 

- 

2', 

6 

)          666.030518 

[     40, 

1, 

6  ' 

)          621.195801 

3.   ITEI 

?4TI0N  3 

:  -     1. 

12. 

15 

)          322.457764 

[  -     1, 

15, 

12  ; 

)          289.038574 

:      12, 

- 

1, 

15  ' 

)                       322.457520 

[     15, 

- 

1. 

12  ; 

►          269.038086 

[     12, 

15. 

-    1  ' 

1          178.622330 

[     15, 

12, 

-    1 

178.622330 

[      8, 

12. 

-    1 

I           92.765416 

[     10, 

- 

1, 

1          118.166716 

[     14, 

- 

1. 

)          182.874771 

(     20, 

- 

1. 

)          296.498291 

(  -    1, 

1, 

6 

)           95.093445 
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(- 


6, 
1. 
6, 

1, 


4.   ITERATION  4 


(  - 


(  - 
(  - 


(  - 


5.   ITERATION  5 


1. 

21. 

1. 

1, 


I] 

1  ) 

6  ) 


6, 

1. 

6 

20, 

6,    - 

5 

7, 

4. 

6 

6, 

20. 

6 

6, 

11. 

6 

6, 

14,    - 

7 

1.    - 

8, 

6 

10. 

17. 

6 

66.218964 

338.431296 

74.488647 

95.093933 


146. 
263, 
281. 
435. 
275. 
206. 
388. 
567. 


091446 
564941 
805176 
876953 
054686 
950  363 
758789 
54174P 


(    - 


36, 

e,  - 

1    ) 

360, 

60,    - 

1    ) 

64,    - 

s. 

1    ) 

500, 

500, 

6    ) 

36,    - 

6, 

1    ) 

360,    - 

60, 

1    ) 

640,    - 

80, 

1    ) 

80, 

8,    - 

1    ) 

487.041504 

1335.837891 

1160.075684 

1789688.000000 

731.306641 
2534.004395 
2574.547363 

942.906250 
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APPENDIX  D   TEST  DATA  EHOM  CASE  STUDY  4: 


A.   SAMPLE  DATA 
1.   CASE  1 


Class 

1 

(  7,  4. 

4  ) 

\  5 ,  o . 

2  ) 

(  2.  3. 

4  ) 

{  5.  2. 

4  ) 

(  6.  6. 

2  ) 

(  4.  5. 

0  ) 

(  4.  3. 

2  ) 

(  6.  3, 

2  ) 

(  5.  2, 

5  ) 

(  0,  5. 

4  ) 

(  4.  3, 

1  ) 

(  3,  2. 

8  ) 

Class 

2 

(  16, 

19. 

21  ) 

(  20. 

21, 

19  ) 

(  22, 

19. 

17  ) 

(  22, 

19. 

18  ) 

(  20. 

20. 

24  ) 

(  17. 

19. 

18  ) 

(  22. 

22. 

19  ) 

(  21. 

21, 

18  ) 

(  26. 

21, 

21  ) 

(  19. 

21. 

17  ) 

(  21. 

15, 

20  ) 

(  18. 

19, 

21  ) 

2. 

CASE  2 

Class 

1 

(  9.  6. 

5  ) 

(    7   ^ 

4  ) 

(  4.  5, 

6  ) 

(  7,  4. 

6  ) 

(  8.  8, 

4  ) 

(  6.  7, 

2  ) 

(  6,  5. 

4  ) 

(  8.  5, 

4  ) 

(  7,  4, 

7  ) 

(  0,  7, 

6  ) 

(  6,  5, 

3  ) 

(  5.  4. 

10) 

Class 

2 

(  14. 

17, 

19  ) 

(  18. 

19, 

17  ) 

(  20. 

17, 

15  ) 

(  20. 

17. 

16  ) 

(  18. 

18, 

24  ) 

(  15. 

17. 

16  ) 

(  18. 

20. 

17  ) 

(  19. 

19. 

16  ) 

(  24. 

19. 

19  ) 

{  17. 

19. 

15  ) 

(  19. 

21. 

16  ) 

(  18, 

19, 

22  ) 
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3.   CASE  3 

Class  : 

L 

Class  2 

(  11.  8, 

7  ) 

(  12,  15,  17  ) 

(   9,  7, 

6  ) 

(  16,  17,  15  ) 

(   6,  8, 

8  ) 

(  18,  15,  13  ) 

(   9,  6, 

8  )   ■ 

(  18,  15,  14  ) 

(  10,10, 

6  ) 

(  16,  16,  22  ) 

(   8,  9, 

4  ) 

(  13,  15,  14  ) 

(   8,  7, 

6  ) 

(  16.  18,  15  ) 

(  10,  7, 

6  ) 

(  17,  17,  14  ) 

(   9,  6. 

9  ) 

{  22,  17,  17  ) 

(   1.  9, 

8  ) 

(  15,  17,  13  ) 

(   8,  7, 

5  ) 

(  17,  19,  14  ) 

(  7,  6,: 

L2  ) 

(  16,  17,  20  ) 

4.   ( 

:ase  4 

Class  : 

L 

Class  2 

(  13,  10 

.   9  ) 

(  10,  13,  15  ) 

(  11,   9 

,      8  ) 

(  14,  15,  13  ) 

(   3.   9 

,    10  ) 

(  16,  13,  11  ) 

(  11.   8 

,  10  ) 

(  16,  13,  12  ) 

(  12,  12 

f      8  ) 

(  14,  14,  20  ) 

(  10,  11 

,   6  ) 

(  11,  13.  12  ) 

{  10.   9 

,      8  ) 

(  14.  16,  13  ) 

(  12,   9 

,   8  ) 

(  15,  15,  12  ) 

(  11,   3 

,  11  ) 

(  2^,  15,  15  ) 

(   3,  11 

,  10  ) 

(  13,  15,  11  ) 

(  10.   9 

,      7  ) 

(  15,  17,  12  ) 

(   9,   8 

f    14  ) 

(  14,  15,  18  ) 

5. 

CASE  5 

Class  1 

Class  2 

(  15,  12 

,    11  ) 

(   8,  11,  13  ) 

(  13,  11 

,    10  ) 

(  12,  13,  11  ) 

(  10,  11 

►  12  ) 

(  14,  11,   9  ) 

(  13,  10 

,    12  ) 

(  14,  11,  10  ) 

(  14,  14 

,    10  ) 

(  12,  12,  18  ) 

(  12,  13, 

,   8  ) 

(   9.  11.  10  ) 

(  12,  11 

,  10  ) 

(  12.  14,  11  ) 

(  14,  11 

r  10  ) 

(  13,  13,  10  ) 

(  13,  10 

,    13  ) 

(  18.  13.  13  ) 

(   6,  13 

,  12  ) 

(  11.  13,   9  ) 

(  12,  11 

»   9  ) 

(  13,  15,  10  ) 

(  11.  10 

,  16  ) 

(  12,  13,  16  ) 
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B.    re?eri:nce  point  test 


1.   CASE 


(  - 
( 

(  - 
(  - 


(  - 
(  - 


b. 


(  - 
( 

(  - 
{  - 


REPERENCE  POINT 

1 

Iteration  1 

-   1. 

42, 

1 

) 

42,  - 

1, 

1 

) 

-    1, 

57, 

42 

) 

"    1, 

47, 

125 

) 

77, 

77, 

1 

) 

77, 

77, 

77 

) 

127,  - 

127, 

3 

) 

-    1,  - 

6. 

1 

) 

-  73,  - 

6, 

1 

) 

Iteration  2 

999, 

999, 

999 

) 

999, 

999, 

1 

) 

500, 

500. 

500 

) 

500, 

500, 

1 

) 

500, 

500, 

999 

) 

500, 

509, 

-  999 

) 

Iteration  3 

125, 

125, 

125 

) 

250, 

250, 

250 

) 

-    1. 

100, 

100 

) 

500, 

500, 

1 

) 

-  999.  - 

999, 

999 

) 

-  999,  - 

999, 

-  999 

) 

500,  - 

500. 

500 

) 

Iteration  4 

55, 

55. 

55 

) 

67, 

67, 

67 

) 

73, 

73, 

73 

) 

33, 

33, 

33 

) 

27, 

27, 

27 

) 

49, 

49, 

49 

) 

Iteration  5 

66, 

66, 

66 

) 

63, 

63. 

63 

) 

69, 

69. 

69 

) 

61, 

61. 

61 

) 

59, 

59. 

59 

) 

0.093977 
.106397 
.029866 
.045806 
.034925 
.014635 
.029114 
.037278 
.046832 


.016088 
.029569 
.015915 
.029797 
.020086 
25.971329 


.015041 
.015589 
.023590 
.029975 
.234499 
.016451 
.203192 


,014684 

014588 

,014609 

017653 

,021412 

014898 


014587 
,014592 

014592 
,014602 
,014620 
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57,     57,     57  )  .014646 


2.   CASE  2 

a.  Iteration  1 

(  -    1,     42,  1  )  .127064 

(  42,  -    1,  1  )  .186043 

(  -   1,     57,  42  )  .043038 

(  -    1,     47,  125  )  .088665 

(  77,     77,  1  )  .058361 

(  77,     77,  77  )  .027151 

(  -  127,  -  127,  3  )  .045052 

(  -    1,  -    6,  1  )  .051349 

(  -   73,  -    6,  -   1  )  .080489 

t.  Iteration  2 

(  999,    999,  999  )  .028986 

(  999,    999,  1  )  .047432 

(  500,    500,  500  )  .028773 

(  500,    500,  1  )  .047993 

(  500,    500,  999  )  .038980 

(  500,    500,  -999  )           109.819839 

c.  Iteration  3 

(  55,     55,  55  )  .027149 

{  67,     67,  67  )  .027073 

(  73,     73,  73  )  .027113 

(  33,     33,  33  )  .030525 

(  27,     27,  27  )  .034905 

(  49,     49,  49  )  .027375 

d.  Iteration  4 

(  66,     66,  66  )  .027069 

(  63,     63,  63  )  .027066 

(  69,     69,  69  )  .027083 

(  61,     61,  61  )  .027073 

(  59,     59,  59  )  .027087 

(  57,     57,  57  )  .027112 


3.   CASE  3 

a.   Iteration  1 

(  -    1,     42,    1  )  .240905 

112 


(  - 
(  - 


(  - 
(  - 
(  - 


42, 
1, 
1, 

77, 

127, 

1, 
73, 


1. 
57, 


1 
42 


47,  125 
77,    1 


77, 

127, 

6. 


77 
3 
1 


6,  -  1 


Iteration  2 


(  999,  999,  999 

(  999,  999,-999 

(  -  999,  -  999,-999 

(  -  1,  -  153,    1 

(  -  999,  -  999,-   1 

(  -  999,  -  999,    1 

(  -  30,  -  180,    1 


c.   Iteration  3 


(  - 


(  - 
(  - 


152, 
66, 
63, 

180, 
75, 
75, 
30, 


900, 

66, 

63, 

30, 
450, 

4:50,- 

180,- 


Iteration  4 


e.   Iteration  5 


(  - 

(  - 

(  - 

(  - 


(  - 
(  - 
(  - 


150, 

150, 

33, 

99, 

180, 

900, 

160, 

10, 

15, 


900,-900 

900,-150 

180,-  99 

540,-  99 

33.   33 

150,  900 

960,-  40 

60,-   2 

90,-   4: 


1  ) 
66  ) 
63  ) 

1 

1 

1 

1 


{  -  30,  -  183, 

(  -  27,  -  180, 

(  -  27,  -  183, 

(  -  30,  -  180,- 

(  -  30,  -  180,-  30  ) 

(  -  33,  -  180,-  33  ) 

(  -  30,  -  180,    1  ) 

{  -  30,  -  177,    1  ) 


.405388 
.091247 
.192553 
.129220 
.061053 
.097261 
.090916 
.177960 


.063691 
.910851 
.064311 
.065192 
.102021 
.102291 
.060995 


.064361 
.060896 
.060875 
.207636 
.063134 
.071101 
.083405 


.061042 
.061103 
.061164 
.062224 
.049189 
.049178 
.060965 
.060952 


.066459 
.048069 
.049638 
.047232 
.209693 
.120490 
.058638 
.059914 
.057103 
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-  120.  -   20,    5 

-  120,  -   20,-   5 


.200673 
.178624 


4.   CASE  4 


a . 


b. 


c. 


Iteration 

1 

(  -    1, 

42, 

1 

(     42, 

- 

1. 

1 

(  -    1, 

57, 

42 

(  -    1, 

47, 

125 

(      ?7, 

77, 

1 

(      77, 

77, 

77 

(  -   127, 

- 

127, 

3 

(  -     1. 

- 

6, 

1 

(  -    73, 

— 

6,- 

•   1 

Iterati< 

3n 

2 

(  -   30, 

-> 

180, 

1 

(    999, 

999, 

999 

(  -  999, 

- 

999, 

0 

(  -  999, 

- 

999, 

1 

(  -  999, 

- 

999,- 

•   1 

(     999, 

999, 

0 

{  -   150, 

- 

900, 

1 

(  -   150, 

- 

900,- 

-   1 

(      66, 

66, 

66 

{      63, 

63, 

63 

(  /    59, 

59, 

59 

(      57, 

57, 

57 

(      61, 

61, 

61 

(      67, 

67, 

67 

Iteration 

3 

(  -   40, 

— 

240, 

1 

(  -   40, 

- 

240, 

10 

(  -    40, 

- 

240. 

0 

(  -    50, 

- 

300, 

0 

(  -    50, 

- 

300, 

50 

(  -    20, 

- 

120, 

1 

(  -    20, 

- 

120,- 

■   5 

(  -   30, 

- 

190. 

1 

(  -   30, 

- 

170, 

0 

d .   Iteration  4 

(  -   150,  -  900,-900  ) 


.712316 
.297319 
.287248 
.656638 
.445736 
.214881 
.331711 
.257414 
.618422 


.194983 
.220502 
.352891 
.353415 
.352478 
.363830 
.208534 
.207464 
.214384 
.214271 
.214157 
.214122 
.214208 
.214425 


,197993 
182372 
196409 
198964 
301546 
,191039 
178492 
,195347 
192591 


219152 
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(    - 

150, 

-  900,-150    ) 

{    - 

-   180,-   99    ) 

(    - 

99, 

-   540,-  99    ) 

180, 

33,      33    ) 

900, 

150,    900    ) 

(    - 

160, 

-   960,-   40    ) 

(    - 

10, 

-      60,-      2    ) 

(    - 

120, 

-20,        5    ) 

.156107 
.159531 
.153407 
.761994 
.430386 
.190221 
.182952 
.708054 


5.   CASE  5 


a.   Iteration  1 


I). 


c . 


d. 


1, 

42, 

1 

42,    - 

1, 

1 

1, 

57, 

42 

1, 

47, 

125 

77, 

77, 

1 

77, 

77, 

77 

-      127,    - 

127, 

3 

1,    - 

6, 

1 

-        73,    - 

Iteration 

6," 
2 

-      1 

-     150,   - 

900, 

1 

30,    - 

180, 

1 

-        75,    - 

450, 

1 

0,    : 

1011,7003 

1, 

86, 

63 

1, 

234, 

168 

-      150,    - 
Iteration 

900, 
3 

0 

40,   - 

240, 

1 

40,   - 

240,- 

-    10 

40,   - 

240, 

0 

50,   - 

300, 

0 

50,    - 

300, 

50 

-        20,    - 

120, 

1 

-        20,    - 

120,- 

-      5 

30,    - 

190, 

1 

30,    - 
Iteration 

170, 
4 

0 

18.325668 
38.237442 

8.180267 
28.016891 
21.455872 
11.546129 
15.333944 

9.163347 
53.390564 


5.632728 

5.433392 
5.564706 
41.082291 
7.130882 
6.409952 
5.621341 


5.484715 
5.150225 
5.450282 
5.485142 
7.647579 
5.441672 
5.168211 
5.413536 
5.458068 


(  -   150,  -  900,-900  ) 
(  -   150,  -  900,-150  ) 


8.136481 
4.560885 
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33, 

-   180,-   99 

) 

99, 

-    540,-   99 

) 

180, 

33,      33 

900. 

150,    900 

160, 

-   960,-   40 

10, 

-      60,-      2 

120, 

-20,         5 

120, 

-      20,-      5 

5.401924 

4.591217 

99.351578 

38.806274 

5.247082 

5.492326 

66.094223 

57.096405 
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APPENDIX  Y      TEST  DATA  FROM  CASE  STUDY  5 


A.   SAMPLE  DATA 
1.   CASE  1 


Class  1 


( 


a ,   Id,   c,   d,   e,   f ,  g,      h,   i ,   j  ) 


(    5 1 

3, 

(   '^  1 

4.. 

>    -  » 

(   0, 

.   5. 

(    5  ^ 

,      4, 

(    3! 

.   8, 

(    5, 

4, 

(    5, 

.   4, 

(    2, 

>      2, 

(      4: 

.   7. 

{    4, 

3, 

(    4 

.   5, 

(    5, 

,      2, 

(    3, 

.   0, 

(    4, 

4, 

(    7 

.   4, 

(    6, 

,       2, 

3 

r    4, 

1, 

4, 

5, 

5. 

5. 

1  ) 

c 

►   4, 

3, 

6, 

4, 

6, 

0, 

2  ) 

si 

.   4, 

3, 

6, 

8, 

2. 

4, 

3  ) 

3, 

5 

4, 

2, 

5  ^ 

6, 

4, 

T 

K^ 

\       4*, 

4, 

6, 

3, 

5, 

1, 

4  ) 

5, 

4, 

1, 

7, 

1, 

0. 

3, 

2  ) 

4, 

r   4, 

4, 

4, 

5, 

3, 

6. 

2  ) 

4, 

7, 

e, 

4, 

6, 

2, 

3, 

6  ) 

6, 

.   3, 

4, 

5. 

2, 

5, 

3, 

5  ) 

R 

»   4, 

4, 

4, 

4, 

5, 

7, 

4  ) 

3' 

»   7, 

3, 

4, 

4, 

4. 

6, 

4, 

>   6, 

2, 

1, 

7, 

4. 

2. 

6  ) 

7, 

,      4, 

4, 

5 

2, 

4. 

4, 

4  ) 

c 

»   5, 

1. 

4, 

3, 

4, 

4, 

4  ) 

3' 

.   4, 

1, 

4, 

4, 

4, 

4, 

7  ) 

01 

.   4, 

2, 

6, 

5  ^ 

2, 

4, 

6  ) 

Class  2 

'   16, 

12, 

18, 

16, 

15, 

19. 

16, 

15, 

,  16, 

17  ) 

'   17, 

14, 

19, 

16 , 

16, 

13, 

15 

14 

,  16. 

18  ) 

14. 

16, 

15, 

is! 

,  19, 

13, 

14, 

16, 

,    19. 

18  ) 

:   16, 

18. 

15, 

15, 

15, 

15, 

17, 

15, 

17, 

17  ) 

'   16, 

16, 

11, 

18, 

,    15, 

13, 

14, 

15, 

,  16. 

14  ) 

:    13, 

16, 

15f 

16, 

19, 

15» 

15, 

16, 

20, 

16  ) 

:    12, 

16, 

16, 

17, 

,    16, 

17, 

19, 

18, 

,    16, 

16  ) 

[   16, 

15, 

15, 

17, 

,    16, 

17, 

16, 

16 

.  16, 

17  ) 

16, 

16, 

14, 

19, 

,  16, 

16, 

16, 

17, 

18, 

17  ) 

:    1?, 

15. 

17, 

17, 

16, 

15, 

16, 

17 

,  18, 

13  ) 

:    17, 

18, 

17, 

16, 

,  15, 

16, 

19. 

19 

,    16. 

16  ) 

[   14, 

18, 

12. 

17, 

13, 

13, 

17. 

17 

.  15, 

16  ) 

[   16, 

13. 

16, 

13 

►  16, 

16, 

18, 

16, 

,  16. 

16  ) 

(   18, 

14. 

15, 

16, 

,    14, 

16. 

16, 

16 

.  19. 

16  ) 

[   16, 

18. 

16, 

IS 

,    17, 

18. 

15  , 

17 

.  18. 

13  ) 

(   13. 

16. 

16, 

18 

f    17, 

14. 

16, 

18 

,  16. 

18  ) 
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2.   CASE  2 

Class  1 

(    5, 

7, 

4, 

6. 

6. 

8. 

8. 

5. 

6, 

6  ) 

(    3, 

2, 

4. 

e. 

3. 

5. 

7. 

3, 

6. 

8  ) 

(    8, 

4, 

6. 

5, 

5, 

5. 

4, 

5, 

6, 

5  ) 

(         ^ 

7. 

8, 

7. 

8, 

5, 

8, 

6. 

9. 

11  ) 

(    6. 

e» 

7. 

4, 

4, 

2. 

9. 

11. 

9. 

9  ) 

(    4, 

10. 

6, 

4, 

6, 

6, 

6, 

6. 

5, 

8  ) 

(    6, 

6. 

7, 

6, 

9, 

6, 

—  » 

6. 

8, 

6  ) 

(    6, 

3, 

6, 

8, 

5, 

6. 

6. 

5, 

7, 

4  ) 

(    4, 

e, 

5. 

8, 

6, 

6, 

2. 

6. 

6  ) 

(    4, 

7, 

e. 

6. 

7, 

6, 

7. 

6, 

4. 

5  ) 

(   e. 

6. 

6. 

5, 

6. 

8. 

4. 

6, 

7. 

8  ) 

(    '?, 

7. 

6, 

9, 

6. 

5, 

5, 

6, 

7, 

6  ) 

(    2, 

7. 

4. 

5. 

9. 

6, 

9, 

6, 

4, 

6  ) 

(    3. 

e. 

2, 

3, 

e. 

5, 

4, 

6, 

5, 

6  ) 

(    5, 

3, 

^  ♦ 

6, 

i0t 

8, 

4, 

5. 

6, 

4  ) 

Class   2 


(   17 

,  21, 

(   16 

,  16, 

{   14 

.  16, 

(   11 

,    15, 

(   14, 

.  15, 

(   13, 

.  15, 

(   15, 

.  15, 

(   14, 

,    13, 

(   14, 

14, 

(   18, 

,  16, 

(   14, 

.  14, 

(   13, 

13, 

(   17, 

.    12. 

(   16, 

16, 

(   13 

.  14, 

(   14, 

17, 

14, 

15, 

15, 

14. 

14 

14, 

14, 

14, 

15. 

15 

13, 

15, 

19, 

12, 

17 

14, 

15, 

15. 

16. 

14 

14, 

15, 

15. 

13. 

15 

12, 

14, 

14. 

14, 

13 

14, 

17, 

15. 

17, 

12 

13, 

15 . 

14. 

15, 

17 

12, 

16*, 

15. 

14, 

15 

14, 

14, 

13, 

14, 

13 

12, 

12, 

14. 

11, 

12 

1  'Z 

14, 

14. 

1  '^ 

15 

14, 

13, 

14. 

14. 

12 

14, 

1  "I 

16, 

13. 

14 

14, 

11, 

13. 

16. 

16 

11. 

12. 

13. 

14. 

14 

.  14. 

.  14. 

♦  14, 

.  16, 

.  12, 

.  16, 

.  11. 

.  14. 

,  13, 

.  13. 

.  11  , 

.  14. 

,  13. 

.  13, 

.  14, 

.  14, 

15, 

15  ) 

14. 

14  ) 

17, 

15  ) 

14. 

14  ) 

12. 

10  ) 

14. 

14  ) 

11, 

12  ) 

14. 

16  ) 

13,* 

17  ) 

14. 

13  ) 

14. 

14  ) 

14. 

15  ) 

16. 

15  ) 

11. 

14  ) 

14. 

14  ) 

14. 

18  ) 

lie 


CASE  3 


Class  1 


8 
12 
7 
11 
8 
11 
9 
7 
9 
7 
8 
6 
9 
9 
9 


8, 

6. 

10. 

7, 

7, 

7. 

8, 

8, 

7. 

9, 

12. 

6. 

10. 

7. 

7, 

8, 

8. 

8, 

8. 

10. 

8, 

8. 

8, 

10. 

8, 

10. 

6. 

8. 

10. 

8. 

6, 

8. 

8. 

8, 

10. 

7. 

9. 

6. 

10. 

7, 

9. 

10. 

7, 

7. 

7, 

9. 

7. 

7. 

8. 

6, 

9, 

8, 

9. 

10. 

8. 

11, 

'?. 

8. 

6, 

8. 

'^. 

8. 

9. 

7. 

9. 

8, 

8. 

7. 

8. 

10. 

e. 

10. 

8. 

6, 

8, 

8, 

10, 

8, 

11. 
7. 

10. 
9. 

10! 
6, 
7, 

14, 
7, 
6, 

e. 

8. 


8. 

7, 

7  ) 

8. 

7, 

3  ) 

9. 

9. 

8  ) 

8. 

8, 

6  ) 

3. 

6, 

8  ) 

10. 

9. 

9  ) 

7. 

5. 

8  ) 

8, 

8, 

9  ) 

9. 

8, 

9  ) 

10. 

10. 

10  ) 

10. 

6, 

11  ) 

9. 

8, 

9  ) 

9. 

8, 

10  ) 

4, 

7. 

7  ) 

9, 

6. 

6  ) 

Class  2 


12 
13 
13 
12 
11 
12 
12 
12 
14 
12 
8 
12 
12 
12 
12 
14 


12 

»  10 

,    12, 

13, 

,  15, 

.  12, 

13, 

>    13  , 

,    12, 

10, 

,    14 

,  16, 

12, 

,      8, 

.  12, 

12, 

,    12 

,    13, 

11, 

,    12, 

13, 

12, 

,    13 

,    12, 

15, 

11, 

.  11. 

13 

,    13 

,  13. 

14, 

.  14, 

,    10. 

13 

,    12, 

,  12, 

13, 

•   9, 

,  14, 

13 

,  13, 

.  12, 

13, 

,  14, 

.  11, 

13 

r  13, 

.  14, 

12, 
8. 
12, 
13, 
12, 
12, 
15, 
13, 
11. 
12, 

11. 
9. 
12, 
12, 
12, 
15. 


13 

,  12 

,  13 

.  12 

,  12  ) 

13 

,  14 

,      9 

,    12, 

.  14  ) 

10, 

,  14 

,  12 

,    11, 

12  ) 

16, 

.  10 

,    10 

,  14, 

,  13  ) 

11, 

,  11 

,   9 

.  11, 

,  11  ) 

14 

,  13 

.  12 

r   11, 

1  '^   ) 

12, 

,   8, 

,  12 

,   11, 

,  14  ) 

14, 

.  15, 

,    11 

.   8, 

1  c;  \ 

13, 

10, 

13 

.  12, 

12  ) 

11 

,  12 

,  12, 

,  11, 

13  ) 

12, 

,  11 

.  14 

,    11, 

.  12  ) 

12, 

.  14, 

,    12, 

.  10, 

12    ) 

11, 

14 

,  12 

,    11, 

,    12  ) 

14, 

.  11, 

.  12, 

.  14, 

12  ) 

12, 

12 

,  13 

,  15, 

12  ) 

9, 

14, 

,  16 

,    12, 

11  ) 
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4.   CASE  4 


Class  1 


(    9, 

.  10, 

,    13, 

,  11, 

11 

.    11, 

,  10, 

12. 

9, 

10  ) 

(   10, 

.  10, 

10, 

.   8, 

14, 

9, 

10. 

9, 

9. 

10  ) 

{   10, 

9, 

,  12, 

>      9. 

9 

,  10 

,      9. 

9. 

10, 

10  ) 

(   12 

.  11, 

.  1'?, 

10, 

11, 

12, 

15. 

11. 

10. 

10  ) 

(   10 

r    7 

,    11, 

.  12. 

10, 

,  10, 

>    10, 

9. 

8, 

10  ) 

(   10, 

.  10, 

,  10, 

.  11. 

9, 

,    10, 

,  11, 

10. 

9, 

10  ) 

(   10, 

,   9 

,  10 

,      9, 

8 

,    13, 

,    11. 

10. 

8. 

9  ) 

(   11, 

10, 

8, 

,      8, 

7, 

,  13, 

7. 

12. 

10. 

10  ) 

(   10 

,  10 

.   8 

,    10, 

10 

,   8 

,   9. 

e. 

10. 

10  ) 

(   11, 

.  10 

,    10 

.  10, 

10 

,  10 

,  12. 

14. 

10. 

13  ) 

(   10 

,  10 

,  10 

»  12. 

10 

.  12, 

.  11. 

11. 

9. 

6  ) 

(   11, 

,  10 

.  15, 

.  10, 

12 

,   8 

,  10. 

8, 

11, 

10  ) 

(    8 

,   11 

,    10 

.  11, 

9 

,  12, 

.  11. 

9. 

9, 

10  ) 

(   10, 

,  10, 

,  10, 

>    10, 

12, 

.   8 

,    10. 

6. 

10, 

14  ) 

(    9 

.  e 

.  11 

.  13. 

10 

,      9, 

,  10. 

10. 

9. 

11  ) 

(    6, 

.  11, 

.  11, 

.  11, 

'^ 

,    10, 

,  10. 

11. 

13. 

10  ) 

Class  2 

;     9, 

12 

(   12. 

8 

:    12, 

14 

(    11. 

10 

'    8. 

12 

[    8, 

8 

:    12. 

13 

:    10. 

6 

8. 

11 

:    10. 

9 

'    10. 

9 

10. 

9 

:     9. 

9 

'    10, 

10 

12, 

10 

12 
11 

9 
10 
10 
10 

9 
11 

8 
10 
11 
10 

9 
11 
12 


,  10, 

7, 

13. 

8. 

10. 

10. 

11  ) 

,  10, 

10. 

10, 

10. 

10. 

12. 

10  ) 

,  12, 

10. 

12. 

6. 

10. 

10. 

14  ) 

,  11, 

11. 

11. 

10. 

9. 

6. 

6  ) 

,  10, 

13. 

10. 

10. 

10. 

10. 

12  ) 

,  13. 

9. 

10, 

9. 

9. 

6. 

12  ) 

,  10, 

12. 

10, 

9. 

9. 

13. 

6  ) 

,  10, 

8. 

11. 

10. 

7. 

10. 

10  ) 

,  11, 

11. 

12, 

12. 

11. 

9. 

9  ) 

,   9. 

10. 

12. 

10. 

8. 

8. 

8  ) 

,   9. 

10. 

1. 

1. 

1. 

1. 

1  ) 

,  11, 

8. 

9. 

10. 

10. 

11, 

10  ) 

,   8, 

10. 

10. 

12. 

10. 

9. 

15  ) 

,   8, 

9. 

7. 

9, 

11. 

11. 

10  ) 

,  10, 

10, 

9. 

10. 

10. 

10. 

10  ) 
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B.   REFERENCE  POINT  TEST 


REFERENCE  POINT 


1.   CASE  1 

a.   Iteration  1 

51,   52,   53,   54,   55,   56,   57,   58,   59.   63  )  .004561 

121,  171,  182,  175,  123,  245,  186,  263,  298,  500  )  .005734 

•  57,-  «^8,-  59,-  60,-  61,-  62,-  63,-  64,-  65,-  66  )  .005002 

•501,-502,-503,-504,-505,-506,-507,-508,-509.-513  )  .004654 

0,-721,-821,-921,-111,-211,-311,-411,-511,-611  )  .006724 


2.   CASE  2 

a.   Iteration  1 

51,   52,   53,   54,   55,   56,   57,   58,   59,   60 

121,  171,  182,  175,  123,  245,  286,  263,  298,  500 

•  57,-  58,-  59,-  60,-  61,-  62,-  63,-  64,-  65,-  66 

•501,-502,-503,-504,-50  5,-506,-507,-508,-509,-510 

0,-721,-821,-921,-111,-211,-311,-411,-511,-611  ) 


.024579 
.034334 
.023966 
.023578 

.032695 


3.   CASE  3 

a.   Iteration  1 

51,   52,   53,   54,   55,   56,   57,   58,   59,   60  )  .063348 

121,  171,  182,  175,  123,  245,  286,  263,  298,  500  )  .078378 

•  57,-  58,-  59,-  60,-  61,-  62,-  63,-  64,-  65,-  66  )  .063750 

■501,-502,-503,-504,-505,-506,-507,-508,-509,-510  )  .062027 

0.-721,-821 .-921,-111,-211,-311,-411,-511,-611  )  .075525 


4.   CASE  4 

a.   Iteration  1 

51,   52,   53,   54,   55,   56,   57.   58,   59,   60)  20.958557 

121,  171,  182,  175,  123,  245,  286,  263,  298,  500)  23.204590 

-57,  -58,  -59,  -60,  -61,  -62,  -63,  -64,  -65,  -66)  21.062271 

-501,-502,-503,-504,-505,-506,-507,-508,-509,-510^  21.05166*=^ 

0,-721,-821,-921,-111,-211,-311,-411,-511,-611^  17.253016 
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b.   Iteration  2 


0,-721,-821 ,-921,-111,-211,-311,-411,-511,  -1 ) 
?•,  -1,-821,-921,-111,-211,-311,-4:11,-511,  -1 ) 
0,  -1.-821, -921, -11 1,-21 1,-311, -41 1,-511, -€11) 
0,  -1,-821, -921, -111, -900, -311, -411, -511, -611^ 
0,   -1,-821,-921,-111,-900,-311,-411,-511,-611) 

c.   Iteration  3 


14.781326 
13.008581 
12.028761 
9.707917 
15.125909 


0, 
0. 
0, 

0, 
0. 


-1,-821,-921,-111,-900.    0,-411,-511,   -1)   19.077774 
-1,-821,-921,-111,  900,  999,-411,-511,   -1)  29116.8437 

16.246217 
13.567417 
51.861021 


-1,-821,-921,-111, 
-1,-821,-421,-111, 
-1,-221,-921,-111, 

L.   Iteration  4 


900,-311,-411,-511,  500) 
900,-311,-411 ,-511,-611) 
900,-311,-411,-511,-611) 


(  0,   -1,-821,-999,-111, 

(  0,-500,-821,-921,-111, 

(  0,   -1,-821,-921,-111, 

(  0,   -1,-821,-921,-111, 


999,-311,-411,-511,-611) 
900,-311,-411,-511,-611) 
900,-999,-411 ,-511.-611) 
900,-666,-411,-511,-611) 


(  -500,   -1.-821,-921,-111,  900,-311,-411,-511,-611 


13.752581 
15.657303 
9.724404 
10. '710649 
15.677959 


e.  Iteration  5 

-500,  -1,-821,-219,-111, 

0,  -1,-821,-219,-111, 

0,  -1,-821,-219,-111, 

0,  0,-821,-219,-111, 

f.  Iteration  6 

0,  200,-821,-921,-111, 

0,  200,-821,-219,-111, 

0,  -1,-821,-921,-111, 

0,  -1,  821,-921,-111, 

0,  -1,-821,-921,-111, 

0,  -1,-821,-921,-111, 

0,  -1,-821,-921,-111, 

0,  -1,-821,-219,-111, 

g.  Iteration  7 

0,  800,-821,-921,-111, 

0,  -1,  999,-921,-111, 

0,  -1,  999,-921,-111, 

0,  800,  999,-921 ,-111, 

0,  -1,-821,-921,-111, 

0,  800,  999,-921,-111, 

0,  800,  999,-921,-111, 


900,-311.-411,-511.-611) 
900,-666,-411 ,-511,-611) 
900,-999,-411,-511,-611) 
900,-999,-411,-511,-611) 


900 , -999 ,-411,-511,-611) 
900,-999,-411 ,-511 ,-611 ) 
900,-222,-411,-511,-611) 
900,-999,-411,-511,-611) 
900,-311,-411 ,-999,-611) 
900,-311,-411,  1,-611) 
900,-311,-411,  500,-611) 
900,-999,-411,-511,-611) 


900,-999,-411,-511,-611) 
900,-311,-411,-511,-611) 
900,-999,-411,-511,-611) 
900,-411,-411,-511,-611) 
900,-311,-411,-511,-999) 
900,-999,-411 ,-511,-999) 
900,-999,-999,-511,-999) 


17.799042 
11.379161 
10.225633 
10.217400 


9.311914 
9.743191 
13.919764 
9.724404 
14.559681 
13.070512 
16.673279 
10.225633 


8.751494 
1364.4433 
59.601532 
40.654962 
15.521662 
43.365723 
31 .393661 
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0. 

0, 
0, 
0. 


800,  999,-921,-111, 

800.  999,-921,-111, 

800,  999,-921,-111, 

800,  999,-921,-111, 


900,-999,  500,-511,-999) 
900,-999,  999,-511,-999) 
900,-999,  1,-511,-999) 
900,-999,-503,-511 ,-999) 


158.365446 
11577.5690 
64.88529 
40.597549 


Iteration  8 


0,  800,-821,-921,-111, 

500,  800,-821,-219,-111, 

500,  -1,-821 ,-921,-111, 

999,  -1,-821,-921,-111, 

999,  800,-821,-219,-111, 

0,  800,-821,-216,-555, 

0,  600,-821,-219,  555, 


900,-999,-411,-511,-611 
900 , -999 , -4 1 1 , -51 1 , -6 1 1 
900,-311,-411,-511,-611 
900,-311,-411,-511,-611 
900,-999,-411,-511,-611 
900,-999,-411 ,-511 ,-611 
900,-999,-411,-511,-611 


6.751494 
8.468962 
11.770139 
11.542337 
8.294548 
9.677239 
9.246635 
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APPENDIX  F   TEST  DATA  FROM  CASE  STUDY  6 

A.   SAMPLE  DATA 

1.   PHASE  1  :  46  SAMPLE  TEST 


( 


Class  1 


Class  2 


a, 


b, 


c, 


d. 


e, 


f, 


h,    i.    j  ) 


(    19, 

124, 

,  239, 

r  267, 

,  266, 

,  263 

r  262, 

,  260, 

,  261, 

260  ) 

230, 

r  ?'71, 

264, 

264, 

261, 

261, 

259, 

260 

260  ) 

(    IS, 

230 

,  271 

,    265 

,  264 

.  262, 

,  262 

r  259, 

259, 

263  ) 

C     2, 

.  225, 

,  239, 

266, 

265, 

,  262, 

261, 

260, 

,  260 

,  260  ) 

(   190, 

,  101 

,  237 

,    268 

,    263 

,  263 

,  262 

,  261 

,  261, 

,  260  ) 

(     8, 

,  227, 

»  239, 

»  266, 

,  264 

,  262 

,  263 

,  260 

,    263 

,  259  ) 

(    10, 

,  227 

,  271 

,  265 

,    263 

,  262, 

,  260 

.  260, 

259 

,  259  ) 

(     4, 

225, 

272, 

,  266, 

263 

r  263, 

,  261 

,    26^ 

,    260 

,    260  ) 

(    39, 

,  233 

,  262 

,  264 

,    263 

,  263, 

,  261 

,    260, 

259 

,  259  ) 

(    32, 

,  231 

r  263, 

,  265, 

,    263 

r  259, 

,  260 

,    259 

,  258 

,    259  ) 

(    19, 

,  227 

,  264 

,  266 

,  263 

r  261, 

,  261 

,    259 

,  258 

.  259  ) 

(    26, 

,  229, 

,  263 

,  266 

,  263 

,  263 

,  261 

,  260 

,  259 

,    259  ) 

(    29 

,  230 

,  264 

,  266 

,    263 

,    260, 

,  260, 

,  260 

,  259 

,  259  ) 

(    24, 

,  230 

,    265, 

,  268, 

,  264 

,  260 

,    260 

,  261 

,    259 

,    259  ) 

(    16 

,  227 

,  267 

,  269 

r  264, 

,  263, 

,  260, 

,  261 

,  259, 

,  259  ) 

(   a. 

,  124 

,  267 

»  266 

,  263 

,  262 

,  261 

,    261 

,  260 

,  259  ) 

(     1, 

,    115 

,  239, 

268, 

265 

,  263, 

,  262, 

261, 

,  260 

,  260  ) 

(   191, 

113, 

240, 

268, 

,  263 

,    263 

,    261 

,    261, 

,    259 

,  260  ) 

(    19, 

,  225 

,  243, 

268, 

265, 

265 

,  262, 

,  262 

,  259 

,    261  ) 

(     6, 

,    225, 

,    269, 

,  265 

,  265 

,    262 

,    262 

,  260 

,  259, 

260  ) 

(   191, 

,  114, 

,    271, 

266, 

,    266, 

263 

,    262, 

,  260 

,  259 

,  260  ) 

(     2, 

,  122, 

,  270, 

,    266, 

,  264 

,    263 

,  262 

,  259, 

,  259, 

260  ) 

(     6, 

,    122, 

r  239, 

268, 

,  266 

,    265, 

,    262 

,  260 

,  260 

,    261  ) 

(     2, 

►  120, 

,    271, 

,    266 

,  264 

,    264 

,    261, 

-  260, 

260 

260  ) 

(    19, 

,  228, 

,  234, 

269, 

,  263, 

267, 

,  259 

,  262 

,    259 

,  260  ) 

(    32 

,    232, 

f    237, 

,    270 

,  264 

,    264 

,    259 

,  262 

,  260, 

260  ) 

(    34, 

,  232, 

,    235, 

,    270, 

,    264, 

265, 

,    259 

,  263 

,  259 

,  261  ) 

(    27 

,  231 

,  238 

,    267, 

,    263 

,    264 

,    259, 

262, 

258 

,    260  ) 

(    34, 

,  235 

,    240, 

,  266, 

,  263 

,  262 

,    259 

,    261, 

,  258 

,  260  ) 

(    16 

,    228 

,    237, 

,  265 

,  263, 

,    263, 

,  ?6<d, 

261, 

259 

260  ) 

(    15, 

,    227, 

,  234, 

265, 

,  265 

,  264 

,    259 

,  262 

,  259 

,  261  ) 

(    32 

,  233 

,    272, 

,  263 

,    264, 

262, 

,  260, 

260, 

258, 

260  ) 
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Class  3 


(    28 

,    119 

,    229 

,  233 

,  267 

,  265 

,    265 

,  263 

,  261 

,    261  ) 

(    29 

,   lie 

,  253 

,  232 

,  268, 

,  265 

,    264 

,    264 

,  260 

,    263  ) 

(    29 

,  122, 

,  231 

,  232 

,  269 

,    265 

,    263 

,    264 

,  260 

,  262  ) 

(    31 

>    123, 

,    232, 

233, 

.  270, 

265, 

,  263, 

,  264 

,  261 

,    262  ) 

(    35 

,  124, 

,    232, 

,  233 

,  271 

,    266, 

,  263 

,  264, 

,    262, 

.  261  ) 

(    40 

,  ^25, 

,  232, 

,    233, 

,  271 

,    265, 

,  263 

,  263 

,  264 

,  258  ) 

(    41 

►  227, 

,  231 

,    234 

,  269 

,  266 

r  264, 

,    263, 

,  263 

,  260  ) 

(    40, 

,  226, 

233, 

277, 

,    239, 

,  266, 

,  264, 

260 

,  264 

,  262  ) 

(    21, 

,  118, 

,    284, 

,  233 

,    269, 

,  265, 

,  261, 

266, 

,  260 

,    262  ) 

(    23, 

122, 

227, 

234, 

267, 

265, 

261, 

,  266, 

,  259, 

262  ) 

(    19, 

,  117, 

,    226, 

,  235 

,  266, 

265, 

261, 

266, 

259, 

262  ) 

(    1?, 

104, 

226, 

236, 

265, 

,    265 

,  264 

,  265 

,    259 

,  26?  ) 

(     4 

,      92, 

,  227, 

.  236, 

,    266, 

,    264, 

266, 

263 

,  261, 

262  ) 

(     1, 

86, 

226, 

239, 

266, 

264, 

,    266, 

,    261, 

,  263 

,  260  ) 

(     1, 

.   81, 

227, 

273, 

264, 

265, 

267, 

260, 

262, 

262  ) 

(   191, 

?e. 

229, 

271, 

264, 

266 

,    266, 

,    260, 

262, 

,  261  ) 

2.   PHASE  2 
Read  each  class  mean 


421  SAr^PLE  TEST 
as  a  column  vector 


class 

: 

L 

2 

component 

a 

121 

.479 

49 

.766 

^ 

133 

.914 

188 

.723 

c 

240 

.907 

242 

.022 

d 

266 

.378 

263 

.657 

e 

264 

.964 

264 

.482 

f 

263. 

.121 

263 

.350 

g 

261 

.736 

261 

.562 

h 

260 

.564 

260 

.693 

i 

260 

.586 

260 

.058 

J 

259, 

.650 

260 

.095 

34. 

165, 

245, 
264, 
264, 
263. 
261, 
261. 
261, 


596 
349 
630 
575 
459 
849 
959 
685 
384 
555 
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B.   PEFERENCE  POINT  TEST 


HEEERENCE  POINT 
1.   48  SAMPLE  TEST 
a.   Iteration  1 
9999,   9999,   9999,   9999,   9999, 

9999,   9999,   9999,   9999,   9999 
•9999,  -9999,  -9999,  -9999,  -9999, 

9999,  -9999,  -9999,  -9999,  -9999 
-50^0,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
•1000,  -9999.  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-  500,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
0,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
750,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
3000,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
7000,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 


1  .592025 


1.551202 


1  .034770 


0.995774 


1.014196 


1.235598 


1 .078592 


1.269396 


1  .633402 


t.   ITERATION  2 


(  -3000,  -9999,  -9999,  -9999,  -9999, 
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-9999,  -9999,  -9999,  -9999,  -9999  )  0.974786 
(  -2000,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.975093 
(  -1500,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.982432 
(  -1299,  -9999,  -9999,  -9999,  -9999. 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.990013 
(  -  900,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.998687 
(  -  700,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999.  -9999,  -9999,  -9999  )      1,005186 

c.   ITERATION  3 

(  -5000,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.034770 
(  -3300,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.978469 
(  -3500,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999.  -9999,  -9999,  -9999  )  0.981921 
(  -3700,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.985854 
(  -3900,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999.  -9999,  -9999  )  0.991339 
(  -4100,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999.  -9999.  -9999,  -9999  )      0.997116 
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(  -4400,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )      1.007870 

d.   ITERATION  4 


-9999,  -5000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-9999,  -1000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-9999,  -  500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-9999,      0,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-9999,    750,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  3000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-9999,   7000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -5000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -1000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -  500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,      0,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 


-9999  )      2.563654 


-9999  )      7.689368 


-9999  )      9.428020 


-9999  )     11.793727 


-9999  )     17.107452 


-9999  )      73.984070 


-9999  )     50.770370 


-9999  )      0.754902 


-9999  )      1.228729 


-9999  )      1.515115 


-9999  )      1.952134 
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(  -3000,    750,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  3.296567 
(  -3000,   3000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  24.588181 
(  -3000,   7000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )     33.357605 

e.   ITERATION  5 

(  -3000,  -9500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.949582 
(  -3000,  -9000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.925911 
(  -3000,  -8500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.901211 
(  -3000,  -P000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.876356 
(  -3000,  -7500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.851815 
(  -3000,  -7000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.828641 
(  -3000,  -6500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.806097 
(  -3000,  -6000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.785749 
(  -3000,  -5500,  -9999,  -9999,  -9999, 
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-9999,  "9999,  -9999,  -9999, 
-3000,  -4500,  -9999,  -9999,  -9999 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4000,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999, 


-9999  )      J^. 768541 


-9999  )      0.747745 


-9999  )      0.747534 


f.  ITERATION  6 

(  -3000,  -3600,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.755150 
(  -3000,  -3200,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.772826 
(  -3000,  -2800,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -999S  )  0.601493 
(  -3000,  -2400,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.847168 
(  -3000,  -2200,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.878674 
{  -3000,  -1300,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.956538 
(  -3000,  -1400,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )      1.069383 

g.  ITERATION  7 


(  -9999,  -9999,  -7000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  ) 


1.733785 
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-9999,  -9999,  -3000,  -9999,  -9999, 

-9999,  -9999,  -9999.  -9999,  -9999 
-9999,  -9999,  -    1,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-9999.  -9999,   4000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,   6000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -9999,  -7000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -9999,  -3000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -9999,  -    1,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999.  -9999 
-3000,  -9999,   4:000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -4500,   8000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -4500,  -7000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -4500,  -3000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 
-3000,  -4500,  -   1,  -9999,  -9999, 

-9999,  -9999.  -9999.  -9999,  -9999 
-3000,  -4500,   4000.  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999 


2.066772 


2.410366 


3.046544 


3.992909 


1.071215 


1.261718 


1.467927 


1  .874722 


2.517179 


0.815090 


1.023657 


1.346619 


2.233199 
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(  -3000.  -4500,  8000,  -9999,  -9999. 

-9999,  -9999,  -9999,  -9999,  -9999  )      4.224475 

h.   IT5:RATI0N  8 


— ."^ 


000,  -4500,  -9999,  -7000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000.  -4500,  -9999,  -5000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,  -3000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,  -1000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,  -    1,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,   2000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,   4000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,   6000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,   8000,  -9999, 

-9999,  -9999,  -9999,  -9999, 
-3000,  -4500,  -9999,  -9000,  -9999, 

-9999,  -9999,  -9999,  -9999. 
-3000,  -4500,  -9999,  -7000,  -9999, 


-9999  )      1.772202 


-9999  )      1.954675 


-9999  )      2.171665 


-9999  )      2.430396 


-9999  )      2.582221 


-9999  )      2.937319 


-9999  )      3.374505 


•9999  )      3.919746 


-9999  )      4.616714 


-9999  )      1.552190 
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-9999,  -9999,  -9999,  -9999,  -9999  )  1.553089 
(  -3000,  -4500,  -9999,  -5000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.554962 
(  -3000,  -4500,  -9999,  -3000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.556623 
(  -3000,  -4530,  -9999,  -1000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.559961 
(  -3000,  -4500,  -9999,  -    1,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.561696 
(  -3000,  -4500,  -9999,   2000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.564777 
(  -3030,  -4500,  -9999,   4000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  1.569691 
{  -3000,  -4500,  -9999,   8000,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )      1.580138 

i.  ITERATION  9 

{  -9999,  -9999,  -9999,  -9999,  -9999, 

-9000,  -9999,  -9999,  -9999,  -9999  )  1.543766 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-7330,  -9999,  -9999,  -9999,  -9999  )  1.526525 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-5000,  -9999,  -9999,  -9999,  -9999  )  1.509349 
{  -9999,  -9999,  -9999,  -9999,  -9999, 

-3000,  -9999,  -9999,  -9999,  -9999  )      1.492971 
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-9999,  -9999,  -9999,  -9999,  -9999, 

-1000,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

1,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

2000,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

4000,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

6000,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

8000,  -9999,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9000,  -9999.  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -7000,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -5000,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -3000,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -1000,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -    1,  -9999,  -9999,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,   2000,  -9999,  -9999,  -9999 


1.4:77160 


1.468720 


1.452930 


1.437694 


1.422396 


1.407335 


1.544096 


1  .527735 


1  .511520 


1.495849 


1  .481759 


1.474133 


1.459345 
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(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  4000,  -9999,  -9999,  -9999  )  1.445719 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  6000,  -9999,  -9999,  -9999  )  1.431514 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  6000,  -9999,  -9999,  -9999  )  1.418290 
(  -9999,  -9999,  -9999,  -9999.  -9999, 

-9999,  -9999,  -9000,  -9999,  -9999  )  1.543633 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -7000,  -9999,  -9999  )  1.529531 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -5000,  -9999,  -9999  )      1.464761 

j.   ITERATION  10 

(  -9999,  -9999,  -9999,  -9999,  -9999. 

-9999,  -9999,  -  1,  -9999,  -9999  )  1.477756 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  2000.  -9999,  -9999  )  1.464210 
(  -9999,  -9999.  -9999,  -9999,  -9999, 

-9999,  -9999,  4000,  -9999,  -9999  )  1.450755 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  6000,  -9999,  -9999  )  1.437445 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  6000,  -9999,  -9999  )  1.424325 
(  -9999,  -9999,  -9999,  -9999,  -9999, 
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-9999,  -9999,  -9999,  -9000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -7000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -5000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -3000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -1000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -  1,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  2000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  4000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  6000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  8000,  -9999 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9000 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -7000 
-9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -5000 
-9999,  -9999,  -9999,  -9999,  -9999, 


1.545251 


1.532997 


1.520181 


1.507595 


1  .495237 


1  .489653 


1.478065 


1  .466319 


1.455643 


1.444137 


1.547930 


1  .538848 


1.531022 
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-9999,  -9999,  -9999,  -9999,  -3000  )  1,523348 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -1000  )  1.514919 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -  1  )  1.510691 
(  -9999,  -9999,  -9999,  -9999,  -9999, 

-9999,    -9999,    -9999,    -9999,      2000    )  1.502452 

(    -9999,    -9999,    -9999,    -9999,    -9999,    -9999, 

-9999,    -9999,    -9999,    -9999,      4000    )  1.494842 

(    -9999.    -9999,    -9999,    -9999,    -9999,    -9999, 

-9999,    -9999,    -9999,    -9999,      6000    )  1.486907 

(    -9999,    -9999,    -9999,    -9999,    -9999.    -9999, 

-9999,    -9999,    -9999,    -9999,       8000    )  1.480084 

k.      ITi^RATION    11 

(    -3000,    -4500,    -9999.    -9999.    -9999. 

9999.   9999.   9999,   9999,   9999  )      0.442269 
(  -3000,  -4500,  -9999,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.747745 
(  -3000,  -4500,  -7000,  -9999,  -9999, 

-9999,  -9999,  -9999.  -9999,  -9999  )  0.615090 
(  -3000,  -4500,  -7500,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )  0.800422 
(  -3000.  -4500,  -8000,  -9999,  -9999, 

-9999,  -9999,  -9999,  -9999,  -9999  )      0.786349 
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{  -3000,  -4500,  -7000,  -9999,  -9999, 

9999,   9999,   9999,   9999,   9999  )      0.452415 
(  -3000,  -4500,  -7000,  -9999,  -9999, 

99999,  99999,  99999,  99999,  99999  )      0.189089 


2.   421  SAMPLE  TEST 
a.   ITERATION  1 
(  -3000,  -4500,  -7000,  -9999,  -9999, 

99999,  99999,  99999,  99999,  99999  )      1.578162 
(  -3000.  -4500,  -7000,-99999,-99999, 

99999,  99999,  99999,  99999,  99999  )      1.310979 
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APPENDIX  C-   TEST  DATA  FROM  CASE  STUDY  7 

A.   SAMPLE  DATA 

The  class  means  only  are  provided.   Read  each  mean  as  a 
colurrn  vector. 


class 


vector 

component 

1 

2 

3 

a 

121. 

,479 

49. 

.766 

34, 

.596 

b 

133. 

.914 

188. 

.723 

185. 

.349 

c 

240. 

.907 

242. 

.022 

239. 

.630 

d 

266. 

.378 

263. 

.657 

245, 

.575 

e 

264, 

.964 

264. 

.482 

264. 

.459 

f 

263. 

.121 

263. 

.350 

264, 

.849 

S 

261. 

.736 

261, 

.562 

263. 

.959 

h 

260. 

.564 

260, 

.693 

261. 

,685 

i 

260. 

.586 

260, 

.058 

261. 

.384 

j 

259. 

.650 

260. 

.095 

261. 

.555 

k 

259. 

.635 

259. 

.328 

260, 

.370 

I 

258. 

.836 

259. 

.073 

259. 

.870 

m 

258. 

.828 

258. 

.332 

259. 

.609 

n 

256. 

.621 

256. 

.606 

259. 

.301 

0 

258, 

.436 

258. 

.423 

259. 

.185 

P 

258. 

.378 

258. 

.233 

259. 

.014 

q 

258, 

.100 

258, 

.306 

259. 

.021 

r 

258. 

.100 

257. 

.963 

258, 

.507 

s 

257, 

.878 

258. 

.044 

258. 

.322 

t 

257. 

.836 

257. 

.613 

256. 

.178 

u 

257, 

.764 

257. 

.788 

258. 

.164 

V 

257. 

.678 

257. 

.576 

258, 

.109 

w 

257. 

.607 

257. 

.628 

258. 

.021 

X 

257. 

.421 

257. 

.343 

257. 

.801 

y 

257, 

.414 

257. 

.365 

257. 

.829 

z 

257. 

.343 

257, 

.292 

257. 

.788 

« 

257. 

.135 

257, 

.255 

257. 

.774 

G 

257, 

.200 

257, 

.219 

257. 

.651 

# 

257. 

.128 

257, 

.095 

257. 

.637 

$ 

257, 

.107 

257, 

.102 

257. 

.479 

% 

257, 

.078 

257. 

.051 

257. 

.418 

S. 

257 

.050 

257, 

.095 

257. 

.493 
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B.   REFERENCE  POINT  TATA 

Read  each  reference  point  as  a  colurrn  vector.   The  value 
of  a  vector  component  across  a  row  remain  constant  unless 
indicated  otherwise.   The  last  component  value  change  to 
occur  rernains  in  effect  until  modified.    The  resulting 
(I  )  is  shown  below  the  corresponding  vector. 


1.   ITERATION  1 


a 

-3000 

D 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

g 

99999 

h 

99999 

i 

9999     99999 

*9999 

J 

9999      99999 

9999 

k 

9999     -9999     99999      9999    •  99999 

1 

9999     -9999     99999      9999     99999 

m 

9999      ...        ...        99999 

-9999 

n 

9999 

-99999 

0 

9999 

-99999 

P 

9999 

-99999 

q 

9999 

99999     99999 

r 

9999 

99999      99999 

s 

9999 

-9999      99999 

t 

9999 

-9999     99999 

u 

9999 

-9999      99999 

V 

9999 

-9999     -99999 

V 

9999 

-9999    -99999 

z 

9999 

-9999     -99999 

y 

9999 

-9999      99999 

z 

9999 

-9999     99999 

« 

9999 

-9999      99999 

G 

9999 

-9999      99999 

# 

9999 

-9999     99999 

$ 

9999 

-9999    -99999 

% 

9999 

-9999     -99999 

s. 

9999 

-9999    -99999 

1.683570   1.844750    3.736396   1.896465   54.177185 
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2.   ITERATION  2 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

€ 

99999 

h 

99999 

i 

99999 

J 

99999 

k 

-6000 

1 

-9999 

m 

-9999 

n 

-9999 

0 

-9999 

P 

-9999 

q 

-9999 

r 

-9999 

s 

-9999 

t 

-9999 

u 

-9999 

V 

-9999 

V 

-9999 

z 

-9999 

7 

-9999 

z 

-9999 

« 

-9999 

0 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-2000 


3000 


7000 


1.828800   1.748404   1.877700   1.802315 
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3.   ITERATION  3 


a 

-3000 

1) 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

s 

99999 

h 

99999 

i 

99999 

i 

99999 

k 

-9999 

1 

-6000 

m 

-9999 

n 

-9999 

0 

-9999 

P 

-9999 

q 

-9999 

r 

-9999 

s 

-9999 

t 

-9999 

u 

-9999 

V 

-9999 

V 

-9999 

z 

-9999 

7 

-9999 

z 

-9999 

« 

-9999 

0 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-2000 


3000 


7000 


-9999 
-6000 


1.823965    1.772686   1.854467   1.785567   1.821434 
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4.   ITERATION  4 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

g 

99999 

h 

99999 

i 

99999 

J 

99999 

k 

-9999 

1 

-9999 

m 

-2000 

n 

-9999 

0 

-9999 

P 

-9999 

q 

-9999 

r 

-9999 

s 

-9999 

t 

-9999 

u 

-9999 

V 

-9999 

w 

-9999 

z 

-9999 

y 

-9999 

z 

-9999 

« 

-9999 

3 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

3000 


7000 


-9999 
-6000 


-2000 


1.763098   1.882494    1.795417   1.822107   1.754014 
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5.   ITERATION  5 


a 

-3000 

b 

-4500 

c 

-7  000 

d 

-9999 

e 

-9999 

f 

99999 

S 

99999 

h 

99999 

1 

99999 

J 

99999 

k 

-9999 

1 

-9999 

m 

-9999 

n 

3000     7000      -9999 

0 

-9999      -9999      -6000 

P 

-9999 

q 

-9999 

r 

-9999 

s 

-9999 

t 

-9999 

u 

-9999 

V 

-9999 

w 

-9999 

z 

-9999 

y 

-9999 

z 

-9999 

« 

-9999 

3 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-2 


00 


30 


00 


1.816326   1.762993   1.802553   1.762321    1.868320 
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6.   ITERATION  6 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

g 

99999 

h 

99999 

1 

99999 

J 

99999 

k 

-9999 

1 

-9999 

m 

-9999 

n 

-9999 

0 

7000 

-9999 

P 

-9999 

-6000 

q 

-9999 

r 

-9999 

s 

-999  9 

t 

-9999 

u 

-9999 

V 

-9999 

V 

-9999 

z 

-9999 

y 

-9999 

z 

-9999 

# 

-9999 

0 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-2000 


3000 


7000 


1.793631   1.789902   1.758676    1.803580   1.771052 
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7.       ITET?ATION    7 


a 
b 
c 
d 

e 
f 

g 
h 
i 

k 
1 
m 
n 

0 

P 

q 

r 
s 
t 
u 

V 
V 

z 

y 

z 

# 
s. 


-3200 
-4500 
-7000 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-6000 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 


-2000 


3000 


7000 


1.787084   1.723260   1.808782   1.764592 
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8.   ITERATION  8 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

g 

99999 

h 

99999 

1 

99999 

J 

99999 

k 

-9999 

1 

-9999 

m 

-9999 

n 

-9999 

0 

-9999 

P 

-9999 

q 

-9999 

r 

-2000 

s 

-9999 

t 

-9999 

u 

-9999 

V 

-9999 

w 

-9999 

z 

-9999 

y 

-9999 

z 

-9999 

« 

-9999 

3 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-1500 


-1000 


_c; 


500 


1.734462   1.764483   1.706574   1.782977 
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9.   ITERATION  9 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

S 

99999 

h 

99999 

i 

99999 

j 

99999 

k 

-9999 

1 

-9999 

m 

-9999 

n 

-9999 

0 

-9999 

P 

-9999 

q 

-9999 

r 

-9999 

s 

-3000 

t 

-9999 

u 

-9999 

V 

-9999 

w 

-9999 

z 

-9999 

7 

-9999 

z 

-9999 

^ 

-9999 

0 

-9999 

# 

-9999 

$ 

-9999 

% 

-9999 

& 

-9999 

-2000 


-1000 


1.895550    1.733106   1.705211   1.811335 
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10.       ITERATION    10 


a 

-3000 

b 

-4500 

c 

-7000 

d 

-9999 

e 

-9999 

f 

99999 

g 

99999 

h 

99999 

1 

99999 

J 

99999 

k 

-1000 

-2000 

1 

-1000 

-2000 

m 

-1000 

-2000 

n 

-1000 

-2000 

0 

-1000 

-2000 

P 

-1000 

-2000 

q 

-1000 

-2000 

r 

-1000 

-2000 

s 

-1000 

-2000 

t 

-1000 

-2000 

u 

-1000 

-2000 

V 

-1000 

-2000 

V 

-1000 

-2000 

z 

-1000 

-2000 

y 

-1000 

-2000 

z 

-1000 

■2000 

« 

-1000 

-2000 

G 

-1000 

-2000 

# 

-1000 

-2000 

$ 

-1000 

-2000 

% 

-1000 

-2000 

& 

-1000 

■2000 

1.644567     1. 

62 

:4708 
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